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METHOD AND APPARATUS FOR ESTIMATING DELAY AND JITTER 
BETWEEN MANY NETWORK ROUTERS USING MEASUREMENTS 
BETWEEN A PREFERRED SET OF ROUTERS 

Jain, BijendraN, 
5 McCloghrie, Keith 

CROSS-REFERENCES TO RELATED APPLICATIONS 

This application is related to patent Application No. 09/583,177 entitled 
"METHOD AND APPARATUS FOR ESTIMATING DELAY AND JITTER 
1 0 BETWEEN NETWORK ROUTERS," having B. N. Jain and K. McCloghrie as 

inventors. This application is assigned to Cisco Technology, Inc., the assignee of the 
present invention, and is hereby incorporated by reference herein. 

BACKGROUND OF THE INVENTION 
Field of the Invention 

15 The present invention relates to computer networks, and, more particularly, to 

a method and apparatus for estimating a network performance metric, such as delay 
and delay-jitter Qitter), between a collection of pairs of network elements (e.g., 
routers) in a network. 

Description of the Related Art 

20 As computer networks grow, in terms of the number of network elements (e.g., 

routers) contained therein, the measurement of network performance metrics becomes 
of increasing importance. By measuring such metrics, network parameters can be 
tuned in order to provide optimal performance. Moreover, the network's architecture 
can be adjusted and growth planned to allow the network to grow in a controllable 

25 fashion. One such metric is the delay experienced by data packets flowing between 
certain of a network's routers (i.e., travel time between the routers). Another is the 
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jitter, or deviation in delay, experienced by such data packets. Thus, there is a 
growing need to continuously monitor network delay and jitter between multiple pairs 
of routers in a network such as an enterprise or service-provider network. In service- 
provider networks, particularly, such performance monitoring is needed in order to 
5 verify service-level agreements between a service provider and customers. 

Unfortunately, current methods of monitoring are not as useful as might be 
desired. For example, one current method for monitoring network delay and jitter 
requires the measurement of delay and jitter between every specified pair of routers by 
exchanging probe packets between routers. As will be apparent to one of skill in the 
1 0 art, the number of pairs of routers that need to be monitored in such a scenario grows 
as a quadratic of N, where N is the number of network routers making up the network. 
Thus, such a measurement technique involves measurements on the order of 
(0(N^)). 

Once generated, the measurement data is collected and processed. The 
1 5 measurement data can then be made available to other applications, such as for the 

tuning of network parameters and the like. As can be seen from the complexity of the 
technique (0(N^)), this measurement scheme does not scale well in large networks as 
the number of specified pairs of routers to be monitored increases dramatically. In 
such cases, the resulting network traffic due to probe packets can be large and, 
20 therefore, unsustainable as a result of the bandvndth consumed thereby. 

This problem of scalability may be further compoimded by the fact that 
networks being deployed are diff-serv (DS) enabled. In such cases, delay and jitter 
characteristics must be monitored for every DS-codepoint in use in the network. Diff- 
serv enabled networks offer a range of data transfer services that are differentiated on 
25 the basis of performance experienced by packets belonging to a particular aggregated 
set of applications or flows. An application requests a specific level of performance 
on a packet-by-packet basis, by marking the type-of-service (ToS) field in each IP 
packet with a specific value, also called DS-codepoint. This value effectively 
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specifies how an enterprise network or a service provider network processes and 
forwards each packet along each hop in the network. 

Moreover, it is often important which routers and links are involved in the 
measurements that are made. For example, it is usually preferable to make the 
5 necessary measurements from a smaller number of routers. This simplifies the 

administration of the network measurement tools because there are fewer installations, 
and fewer instances of the tools to run. Additionally, it is often desirable to avoid 
sending measurement traffic over already-congested links. Preferably, such traffic is 
sent over links having at least a modicum of excess bandwidth, so as not to interfere 
10 with actual network traffic. Meeting these and other such objectives simplifies 

network administration by minimizing the need for user interaction and a network's 
administrative burden. 

What is therefore needed is a method and apparatus for the measurement of 
delays encountered by network traffic in traversing a network, the complexity of 

15 which preferably grows at a rate less than 0(N^). More preferably, the complexity of 
the measurement scheme should grow at a rate that increases at most linearly with the 
number of network routers (designated herein as N) and the number of network links 
(designated herein as M). Moreover, such a technique should address the situation in 
which an operator desires some modicum of control over the nodes and links over 

20 which measurements are made. 

Summary of the Invention 

The present invention, in various embodiments, addresses the aforementioned 
problems by providing techniques for measuring network performance metrics, such 
as delay encountered between nodes in a network, and delay-jitter (jitter) observed 
25 therein. Advantageously, embodiments of the present invention allow such 

measurements to be made between preferred nodes of the network, without generating 
excessive network traffic, and are capable of accoimting for delays both between 
nodes (the delay over inter-node links) and within nodes. Also advantageously, 
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embodiments of the present invention are less demanding from a measurement 
perspective, being on the order of N+M (0(N+M)). 

A delay measurement technique according to an embodiment of the present 
invention is based on the precept, ascertained by the inventors, that a link between 
5 network nodes will often contribute to the delay encountered between several different 
pairs of network nodes. Such a technique identifies the path between each pair of 
nodes by a list of links that form the path. Paths that are orthogonal are treated as 
being necessary for determining the delays encountered between nodes. Once delay 
and jitter over the requisite set of orthogonal paths have been measured, delay over all 
10 other paths can be determined in terms of the delay and jitter encountered over one or 
more of these orthogonal paths. Such a technique also lends itself to a vector/matrix 
representation of delay and jitter over the paths, and the use of matrix manipulation 
techniques in deriving delay and jitter. 

The techniques described herein provide several advantages. Such techniques 
1 5 permit a network operator some measure of control over the network elements and 
network links involved in the measurements taken by such a procedure^ allowing the 
operator to minimize the number of network elements involved, traffic over congested 
links and so on.. These techniques also address the fundamental concern of a 
measurement scheme's scalability in monitoring delay and jitter in increasingly large 
20 networks, with known or partly known topology and routing. The techniques result in 
a significant reduction in traffic overhead due to exchange of probe packets when 
compared to existing techniques. The savings can be especially significant in 
networks having a large requirements set. Further, in a network employing TCP/IP 
protocols, the methods described herein separately accounts for IP-level transfer delay 
25 over a link and the delay in processing probe packets within a router (i.e., the delay 
experienced in generating and/or receiving such packets), thereby helping to isolate 
and identify links that are over or under provisioned. Simplicity and ease of 
implementation are also attractive features of a technique according to the present 
invention. 
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In one embodiment of the present invention, a method of determining a 
network performance metric in a network is described. The network includes a 
number of network elements and a number of links. Each of the network elements is 
coupled to at least one other of the network elements by at least one of the links. The 
5 method includes forming a first set of network element pairs, ordering a first number 
of network element pairs, forming a second set of network element pairs, measuring a 
measured network performance metric between a first network element pair and 
computing a computed network performance metric. The first set of network element 
pairs include a number of pairs of the network elements. The ordering of a first 

10 number of network element pairs includes network element pairs in the first set of 
network element pairs. The second set of network element pairs includes network 
element pairs in the first set of network element pairs. The measurement is taken 
between a first network element pair. The first network element pair includes a first 
network element and a second network element of one of the network element pairs in 

15 the second set of network element pairs. The computed network performance metric 
is computed between a second network element pair using the measured network 
performance metric. The second network element pair includes a first network 
element and a second network element of the network element pair in the first set of 
network element pairs. 

20 The foregoing is a summary and thus contains, by necessity, simplifications, 

generalizations and omissions of detail; consequently, those skilled in the art will 
appreciate that the summary is illustrative only and is not intended to be in any way 
limiting. As will also be apparent to one of skill in the art, the operations disclosed 
herein may be implemented in a number of ways, and such changes and modifications 

25 may be made without departing from this invention and its broader aspects. Other 
aspects, inventive features, and advantages of the present invention, as defined solely 
by the claims, will become apparent in the non-limiting detailed description set forth 
below. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention may be better understood, and its numerous objects, 
features, and advantages made apparent to those skilled in the art by referencing the 
accompanying drav^ings. 

Fig. 1 A is a block diagram illustrating a computer system. 

Fig. IB is a block diagram illustrating the various sources of delay 
encountered by network traffic transiting a network. 

Fig. 2 is a block diagram depicting a network in which a delay measurement 
technique according to an embodiment of the present invention can be practiced. 

Fig. 3 is a flow diagram illustrating a process for computing the round-trip 
delay between pairs of routers according to the present invention. 

Fig. 4 is a flow diagram illustrating a scheme according to the present 
invention for ordering router pairs in a requirements set. 

Fig. 5 is a flow diagram illustrating a method according to the present 
invention for identifying a preferred measurements set. 

Fig. 6 is a block diagram illustrating an exemplary enterprise network in which 
a method according to an embodiment of the present invention can be practiced. 

The use of the same reference symbols in different drawings indicates similar 
or identical items. 

DETAILED DESCRIPTION OF THE INVENTION 

The following is intended to provide a detailed description of an example of 
the invention and should not be taken to be limiting of the invention itself. Rather, 
any number of variations may fall within the scope of the invention which is defined 
in the claims following the description. 
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Introduction 

Embodiments of the measurement techniques described herein address the 
central issue of scalability. These methods allow (a) network performance metrics, 
such as delay and jitter, to be measured between a significantly smaller subset of pairs 
5 of routers, and (b) the corresponding metrics for the remaining specified pairs of 
routers to be computed based on these measurements. These methods include (a) the 
identification of network paths for which measurements must be undertaken, and (b) 
the computation of the metrics for the remaining specified pairs of routers for which 
measurements are not taken. Advantageously, the present invention allows control 
10 over which routers and links such measurements are taken, 

A measurement scheme according to the present invention employs a 
measurements set and a requirements set, which are defined herein as follows: 

1. The "requirements set" is defined herein as the specified collection of pairs of 
routers for which delay and jitter metrics are to be obtained. 

15 2. The "measurements set" is defined herein as the set of router pairs for which 

delay/jitter measurements are to be taken. A fundamental property of the 
measurements set is that, based on measurements thus obtained, one can 
accurately compute (estimate) delay/jitter metrics for router pairs specified in 
the requirements set. 

20 The methods described herein are based on a technique that divides the end- 

router-to-end-router path in terms of processing delay within the source and 
destination routers and the IP-level transfer delay over intermediate link(s) (and 
router(s), if any) in the network path between the pair of end-routers. Moreover, 
techniques according to embodiments of the present invention can also be used in 

25 scenarios in which the internal topology of the network being analyzed is partly 
unknown. Central to these concepts is (a) the identification of a minimal 
measurements set from a given requirements set and (b) the estimation of delay and 
jitter for pairs of routers in the requirements set. It will be noted that, although the 
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1 X 

techniques disclosed herein are generally applicable to various network protocols and 
topologies, these techniques are discussed herein in terms of TCP/IP protocols. 

Depending upon the order in which the pairs of routers in the requirements set 
(O) are listed and processed, one of many possible measurements sets can result. The 
5 set of router pairs between which measurements should be made is thus dependent (at 
least in part) on the ordering of the requirements set. The specific measurements set 
(Q) sought is one that requires measurements to be made between one or more 
preferred set of router pairs. For example, in a given network, a requirements set v^U 
contain a given assemblage of router pairs. For the given requirements set, there will 
10 be a set of router pairs that, once delay and delay-jitter are measured between those 
routers, allow delays between other router pairs to be computed (estimated). These 
router pairs make up the measurements set. 

However, the ordering of router pairs in the requirements set affects the 
determination of pairs of routers in the measurements set. Typically, the router pairs 

15 in the requirements set can be ordered in any number of ways. However, it is often 
desirable to control which router pairs are in the measurements set. The inventors 
discovered that the router pairs in the measurements set can be controlled by altering 
the ordering of router pairs in the requirements set. This ability to control which 
router pairs are in the measurements set is desirable because such control can allow an 

20 operator to minimize the number of routers on which active network monitoring tools 
(ANMTs) must be run (or links over which measurement traffic must travel), to 
minimize measurement traffic over critical links and to avoid the need to run ANMTs 
on critical or over-stressed routers, among numerous other advantages. 
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To provide such advantages, a measurement scheme according to the present 
invention identifies the measurements set from a given requirements set by: 

1 . Specifying the sequence of routers, in decreasing priority, from which 
5 measurements are initiated. 

2. Expressing delay between each pair of routers in the requirements set, O, as a 
Unear function of delay components and constructing the matrix F, 

3. Using Gauss ehmination (or another equivalent thereof) to decompose matrix 
F into a lower-triangular matrix A and an upper-triangular matrix F', till all 

1 0 independent row vectors of F have been identified. 

4. Using the non-zero row vectors in F' to determine the measurements set, Q. 

The matrix F' identifies the independent row vectors, while matrix A allows a 
dependent row of F to be expressed in terms of the independent rows of F. Pairs of 
routers that correspond to the independent rows of F directly help one to determine the 
15 measurements set, 

Other than resulting in considerably reduced network traffic due to probe 
packets, a monitoring scheme based on the present invention enables one to compute 
(estimate) the IP-level transfer delay over each router-to-router link in the network. 
Such an estimate factors out the delay in processing (generating/receiving) probe 
20 packets within a router. This is desirable because the delay in processing probe 

packets can be significant as a result of probes being generated and received within 
the application layer. It will be apparent to one skilled in the art that an assessment of 
IP-level transfer delay over each link assists a network administrator in identifying 
congested links in a fimctioning network, 

25 The methods described above are applicable to networks for which (a) 

topology and routing information is available, and (b) changes in topology and routing 
are infrequent. These methods may also be extended to apply to networks that are 
built around a network backbone, the topology and routing of which are unknown. 
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Such a method directly provides a measurements set and a scheme for estimating 
delay and jitter between the routers on such a network. As a result, one is also able to 
apportion the delay-components between the enterprise network and the backbone 
network. 

5 The techniques described herein provide several advantages. Chief among 

them is the ability to control, to the extent feasible, which routers and links are 
involved in actual measurements. Moreover, these techniques address the 
fundamental concern of a measurement scheme's scalability in monitoring delay and 
jitter in increasingly large networks, with known or partly known topology and 

10 routing. The techniques result in a significant reduction in network traffic overhead 
due to exchange of probe packets when compared to existing techniques. The savings 
can be especially significant in networks having a large requirements set. Further, the 
methods described herein separately account for IP-level transfer delay over a link and 
the delay in processing probe packets within a router (i.e., the delay experienced in 

1 5 generating and/or receiving such packets), thereby helping to isolate and identify links 
that are over or under provisioned. Simplicity and ease of implementation are also 
attractive feature of these techniques. 

Measurements Using a Preferred Measurements Set 

An active network monitoring tool (referred to generically herein as an 
20 ANMT) can be used to measure round-trip delay, delay variation (jitter) and packet 
loss between a specified set of pairs of routers (or a network switch with a router 
switch module or an attached one-arm router) in a large diff-serv enabled enterprise 
network. By design, ANMT software running as an application on a router (e.g., a 
source router), sends a sequence of user datagram protocol (UDP) packets (also 
25 known as probe packets) to a specified port on a remote device (e.g., a destination 
router). Based on information contained in UDP responses received fi-om the 
destination, the ANMT software running on the source router computes various 
statistics, such as average round-trip delay, standard deviation of delay jitter, and 
average fraction of packets dropped. An ANMT may also be used to test TCP-level 
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connectivity or to estimate one-way packet loss and delay-variation. Additionally, an 
ANMT allows monitoring of performance between devices in a network which offers 
differentiated services. 

A method according to one embodiment of the present invention permits the 
5 use of a network measurement tool (e.g., an ANMT) to measure round-trip delay and 
jitter between a much smaller subset of pairs of routers (represented herein by the 
notation Q), in order to estimate delay and jitter between pairs of routers in a specified 
set (represented herein by the notation O). This subset Q includes at most (N+M) 
pairs of routers, where N is the number of enterprise routers, and M is the number of 
10 links. This is a significant improvement over the complexity of measuring delay 

between every pair of routers in the set O using a tool such as an ANMT. It will be 
noted that the number of pairs of routers in O may be as large as N(N+l)/2, or 0(N^). 
Second, the techniques discussed herein recognize that delay encountered in 
generating, receiving and processing probe packets within the transport and 
1 5 application layers in a router may be significant. 

Fig. lA depicts a block diagram of a computer system 10 suitable for 
implementing the present invention. Computer system 10 includes a bus 12 which 
interconnects major subsystems of computer system 10 such as a central processor 
14, a system memory 16 (typically RAM, but which may also include ROM, flash 

20 RAM, or the like), an input/output controller 1 8, an external audio device such as a 
speaker system 20 via an audio output interface 22, an extemal device such as a 
display screen 24 via display adapter 26, serial ports 28 and 30, a keyboard 32 
(interfaced with a keyboard controller 33), a storage interface 34, a floppy disk drive 
36 operative to receive a floppy disk 38, and a CD-ROM drive 40 operative to receive 

25 a CD-ROM 42. Also included are a mouse 46 (or other point-and-click device, 

coupled to bus 12 via serial port 28), a modem 47 (coupled to bus 12 via serial port 
30) and a network interface 48 (coupled directly to bus 12). 

Bus 12 allows data communication between central processor 14 and system 
memory 16, which may include both read only memory (ROM) or flash memory 

- 11 - 

649926 v3 

Client Ref. No.: 67867 Weil No.: 2252 



Attorney Docket No.: M-8368 US 



(neither shown), and random access memory (RAM) (not shown), as previously 
noted. The RAM is generally the main memory into which the operating system and 
application programs are loaded and typically affords at least 16 megabytes of 
memory space. The ROM or flash memory may contain, among other code, the Basic 
5 Input-Output system (BIOS) which controls basic hardware operation such as the 
interaction with peripheral components. Applications resident with computer system 
10 are generally stored on and accessed via a computer readable medium, such as a 
hard disk drive (e.g., fixed disk 44), an optical drive (e.g., CD-ROM drive 40), floppy 
disk unit 36 or other storage medium. Additionally, applications may be in the form 
10 of electronic signals modulated in accordance with the application and data 

communication technology when accessed via network modem 47 or interface 48. 

Storage interface 34, as with the other storage intefaces of computer system 
10, may connect to a standard computer readable medium for storage and/or retrieval 
of information, such as a fixed disk drive 44. Fixed disk drive 44 may be a part of 

15 computer system 10 or may be separate and accessed through other interface systems. 
Many other devices can be connected such as a mouse 46 connected to bus 12 via 
serial port 28, a modem 47 connected to bus 12 via serial port 30 and a network 
interface 48 connected directly to bus 12. Modem 47 may provide a direct connection 
to a remote server via a telephone link or to the Internet via an internet service 

20 provider (ISP). Network interface 48 may provide a direct connection to a remote 
server via a direct network link to the Internet via a POP (point of presence). 

Many other devices or subsystems (not shown) may be connected in a similar 
manner. Conversely, it is not necessary for all of the devices shown in Fig. 1 A to be 
present to practice the present invention. The devices and subsystems may be 
25 interconnected in different ways from that shown in Fig. 1 A. The operation of a 

computer system such as that shown in Fig. 1 A is readily known in the art and is not 
discussed in detail in this application. Code to implement the present invention may 
be operably disposed or stored in computer-readable storage media such as one or 
more of system memory 16, fixed disk 44, CD-ROM 42, or floppy disk 38. 
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It will be noted that the variable identifier "N" is used in several instances in 
Fig. 1 A to more simply designate the final element of a series of related or similar 
elements. The repeated use of such variable identifiers is not meant to imply a 
correlation between the sizes of such series of elements, although such correlation 
5 may exist. The use of such variable identifiers does not require that each series of 
elements has the same number of elements as another series delimited by the same 
variable identifier. Rather, in each instance of use, the variable identified by "N" may 
hold the same or a different value than other instances of the same variable identifier. 

Moreover, regarding the signals described herein, those skilled in the art will 
10 recognize that a signal may be directly transmitted from a first block to a second 
block, or a signal may be modified (e.g., amplified, attenuated, delayed, latched, 
buffered, inverted, filtered or otherwise modified) between the blocks. Although the 
signals of the above described embodiment are characterized as transmitted from one 
block to the next, other embodiments of the present invention may include modified 
1 5 signals in place of such directly transmitted signals as long as the informational and/or 
fixnctional aspect of the signal is transmitted between blocks. To some extent, a signal 
input at a second block may be conceptualized as a second signal derived from a first 
signal output from a first block due to physical limitations of the circuitry involved 
(e.g., there will inevitably be some attenuation and delay). Therefore, as used herein, 
20 a second signal derived from a first signal includes the first signal or any 

modifications to the first signal, whether due to circuit limitations or due to passage 
through other circuit elements which do not change the informational and/or final 
functional aspect of the first signal. 

The foregoing described embodiment wherein the different components are 
25 contained within different other components (e.g., the various elements shown as 
components of computer system 10). It is to be understood that such depicted 
architectures are merely exemplary, and that in fact many other architectures can be 
implemented which achieve the same functionality. In an abstract, but still definite 
sense, any arrangement of components to achieve the same fiinctionality is effectively 
30 "associated" such that the desired fimctionality is achieved. Hence, any two 
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components herein combined to achieve a particular functionality can be seen as 
"associated with" each other such that the desired functionaUty is achieved, 
irrespective of architectures or intermedial components. Likewise, any two 
components so associated can also be viewed as being "operably connected", or 
5 "operably coupled", to each other to achieve the desired functionality. 

Fig. IB depicts a block diagram illustrating the various sources of delay 
encountered by network traffic transiting a network 100. While a method according 
to an embodiment of the present invention may be practiced using any one of a 
number of protocols. Fig. IB is illustrated in terms of a TCP/IP network protocol. 

10 Delay can be apportioned into monitor application response delay (exemplified in Fig. 
IB by monitor application response delays 105 and 110) and network layer transfer 
delays (exemplified in Fig. IB by network layer transfer delays 1 15(1)-(N)) over an 
(end-to-end) network path 120 between a source router 125 and a destination router 
130. In transiting network 100, network path 120 may also transit one or more 

15 intermediate routers (exemplified in Fig. IB by an intermediate router 135). Source 
router 125, intermediate router 135 and destination router 130 are also designated as 
Rj, R2, and Rj^, indicating the progression of network traffic transiting network 100. 
In a TCP/IP environment such as that of network 100, monitor application delays 105 
and 110 include, respectively, delays attributable to a network monitor 140, and 

20 transport layer 145, a transport layer 146 and a network monitor 141 . In a similar 
fashion, network layer transfer delays 1 15(1)-(N) include delays attributable to 
moving IP packets through and between IP layers 150, 151 and 152, intermediate 
layers 155, 156 and 157, and physical layers 160, 161 and 162, in the manner shown 
in Fig. IB. As can be seen in Fig, IB, the two principle types of delay components 

25 contributing to the round-trip delay between a pair of routers such as source router 
125 and destination router 130 when measured using an ANMT can be defined as: 
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dj J = 1 , 2, . . . , M, the round-trip IP-level delay in transferring an IP packet 
over a link, Lj, between two adjacent routers; and 



5 



i = 1, 2, . . N, the time to generate, receive and process a probe packet 
within transport and application layers in a router, R^. 



The symbols used herein in describing techniques according to various embodiments 
of the present invention for estimating round-trip delay and jitter between a specified 
set of pairs of routers are now presented. 



components of the delay existing between various pairs of routers that make up 
network 200. As is illustrated in Fig. 2, network 200 includes a number of routers 
(exemplified in Fig. 2 by routers 210(l)-(6)) which are coupled to one another by a 
number of interconnecting links (exemplified in Fig. 2 by links 220(1)- (9)). In order 

15 to facilitate the following discussions, routers 210(l)-(6) are also designated R]-R^, 
respectively. In similar fashion, links 220(1 )-(9) are referred to using L^-Lg, 
respectively. In the general sense, network 200 can be described as including N 
routers, Rj, i = 1 , 2, . . . , N, and M interconnecting links, Lj, j - 1 , 2, . . . , M. A route 
between a given pair of routers, = (R^, Rj), is specified as an ordered list of 

20 intermediate links that network traffic between R^ and Rj traverses: 



That is, network traffic moving from source router R^ to destination router R^ traverse 
25 the links, Lp, L^, . . . , and L, in that order, and vice-versa, in the other direction. 

For a given DS codepoint, the routes between routers, Rj and Rj, of network 
200 are given in Table 1 . It v^U be noted that the routes in Table 1 are specified for a 
given DS codepoint, and in terms of intermediate links. 



10 



Fig, 2 is a block diagram depicting a network 200 that illustrates the 



link j)ath(R„ Rj) = <Lp, L^, . . . , L > 



(1) 
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L3 






R2 








L4 
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L2? L7 


R3 










u 


L, 


R4 










u 


Lg, L9 


R5 














R6 















Table 1. Routing table for network given in Fig- 2. 

As noted, the two principal types of delay components that contribute to the 
round-trip delay between a pair of routers when measured using an ANMT can be 
defined as dj J = 1 , 2, . . . , M (the round-trip IP-level delay in transferring an IP packet 
over a link, Lj), and s,, i - 1 , 2, . . . , N (the time to generate, receive and process a 
probe packet within transport and application layers in a router, Ri). 



10 



As a result, the round-trip delay between any given pair of routers, and Rj, is 
given by: 

Delay(Ri, Rj) = s^ + d^ + d^ + ... + d, + Sj 



(2) 



15 



assuming that the route between Ri and Rj is known and specified in terms of the 
intermediate links. That is, 

link_path(Ri, R^) - <Lp, L^, . . . , L > 



(3) 



When used between routers, R^ and R^, a delay monitoring tool such as an ANMT 
measures Delay(Ri, R|). Such measurements may include measurement errors. 

The requkements set and measurements set can now be defined using the 
20 framework set forth above. 

The user-specified requirements set of P number of pairs of routers between 
which round-trip delay is to be measured is given by 



25 



(D=^{7t„k-^1,2,-..,P} 



(4) 



where 
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(Ri,Rj) 



(5) 



and so 



(6) 



Normally, the subset will only be a small fraction of all possible pairs of routers. As 
noted, because round-trip delay or jitter is monitored, it is immaterial whether the pair 
of routers is specified as % = (R^, Rj) or as % = (R,, Ri). 

The estimate is based on measurements between a subset of pairs of routers 
(and indeed what can be a minimal subset of router pairs), which may be referred to 
by Q. That is, for every (R^, Rj,) e the delay between the pair of routers (R^, Rj) 
can be computed (or estimated) in terms of measured delay between one or more pairs 
of routers {(Rp, R^)} e Q, The set, Q, is also referred to herein as the measurements 
set. A method according to the present invention identifies the measurements set, Q, 
for a given requirements set, O. 

Determination of the Measurements Set 

A method according to an embodiment of the present invention is now 
described that is capable of identifying the collection of pairs of routers, or Q, such 
that the delay between a given pair of routers (R^, R^,) e O can be computed from 
measurements between a subset of pairs of routers (Rp, R^,) e Q. 

If the number of pairs of routers in O is defined as P (or, P = lOj), the round- 
trip delay between the pair of routers, (R^, R,,) g O is denoted by = Delay(Ri, R^). 
In view of the definition of delay components, it can be seen that, for every k = 1, 2, 
...,P: 



= Delay(Ri, Rj) = s^ + dp + d^ + . . . + d, + Sj 



(7a) 



assuming that the route between R^ and Rj is known and given by 
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linkj3ath(R„ Rj) = <Lp, L^, . . L,> 
Using a vector notation, -l^ = Delay(Ri, Rj) may be re- written as 
5 Zk = Delay(Ri,R3) 

= S. + dp + dq+...+d,+ Sj 

10 where 



(7b) 

(7c) 
(7d) 
(7e) 



Fk = [0 ... 0 1 0 ... 0 1 0 ... 0 1 0 ... 0 1 0 ... 0 1 0 ... 0] 



(8) 



is a row vector of size N+M, and the 1 's in Fj^ appear in columns p, q, . . ., r, and in 
1 5 columns M+i and M+j ; and 

X is a vector of size N+M (the delay-components vector): 



20 



25 



[da 
[... 

[dw 

[... 

[Sn 



(9) 



30 



As noted, the roimd-trip delay between the specified pairs of routers in O = 
= (Rj, Rj), k = 1, 2, P}, Z|j = F^x and k= 1,2, P, can be re-written as a vector 
equation 



z = F X 



(10a) 



35 



where 



z = 



[Z2 



(10b) 
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[... 

[Zp 



and 



F 




(10c) 



The P X (N+M) matrix, F, plays an important role in determining the subset of pairs of 
routers between which delay measurements are necessary. 

Consider the row vectors, F^, k = 1 , 2, . . . , P and let Q be the maximum 
nvimber of independent row vectors. As can be seen, Q is equal to the rank of matrix 
F (i.e., Rank(F)). Without loss of generality, let F, Fj . . . Fq be the independent row 
vectors of matrix F. This is without loss of generality because the row vectors F^ in F 
(and similarly the corresponding pairs of routers m O) can be re-arranged, if 
necessary. Then, every row vector F^, k = Q+1, Q+2, . . ., P, can be expressed as a 
linear combination of row vectors, F^, k = 1, 2, . . ., Q. 

The relationship between the hnearly independent and linearly dependent rows 
of F is now examined. If F„ Fj, . . ., Fq is a maxunal set of linearly independent rows 
of F, then row vectors ¥(^2> . . . , Fp can be expressed as a linear combination of F„ 
Fj, . . ., Fq. In other words, F^ can be expressed in terms of: 



The constants a^^ may be re-organized in the form of a row vector (of size Q) in the 
following manner: 



(ayFi),k = Q+l,Q+2. 



(11) 



ai,= [a^u ak,2, ak.Q]. k = Q+1, Q+2: 



(12) 
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The values of aK may be aggregated to form the PxQ matrix. A, which can be defined 
as: 



A= [I 

[aQ+2 

[••• 

[ttp 



where the matrix, I, is a Q x Q matrix. 



(13) 



Because delay (z^ is a random variable, delay-jitter between pair of routers 
= (R;, Rj)) can, be defined as follows: 

Delay- Jitter(Ri, R^) = V E{ (z^ - E{z^}f } (14) 

where E{.} is the expectation operation. 

A measurements set can be defined as the set of Q number of pairs of routers 
between which a network administrator uses an ANMT to measure round-trip delay, 
and is given by 

Q = {7r', = (R4,Rj),k=l,2,...,Q} (15) 

Router-to-router delay and delay-jitter is measured for the measurements set using an 
ANMT. When used between a pair of routers, % = (R^, Rj), an ANMT measures 
Delay(Ri, R,) to yield 



yk = Zk + Vk 



(16a) 



Using an ANMT, one typically makes several measurements, y,,', during the time 
interval (to, to +dt), and returns the statistical average, 

y^ = statistical_avg(y],') ( ^ 
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as well as the observed standard deviation 

= V statistical_avg((yk - Yk )^) ^^^^^ 

The above delay and delay-jitter measurements may be organized in the form of a 
vector, y, of size Q: 

y- [y.] (17) 
[y2] 
[...] 

[yq] 

and a matrix, T, of size QxQ: 

r= [Yi 0 0 ... 0] (18) 
[0 72 0 ... 0] 
[... ] 
[0 0 ... 0 Yq] 

Estimates can then be made for router pairs in the requirements set, O. The delay 
estimate vector, A, is then calculated. More specifically, an estimate of delay betv^een 
the pair of routers, % = (Ri, R^) e <D, is denoted by A^. The vector. A, of size P, 
denotes an estimate of delay for all pairs of routers in O. 

An estimate of delay-jitter between the pair of routers, % - (Ri, Rj) g O, is 
denoted by a^. The vector, a, of size P, denotes an estimate of delay-jitter for all pairs 
of routers in O. 

In regard to a measurement method according to certain embodiments of the 
present invention, certain assumptions concerning the network being analyzed are 
now summarized. The network is assumed to have the following characteristics: 

• For the embodiments discussed above, it is assumed that the network's topology is 
knovm. It will be noted that, because a route between a pair of routers is specified 
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in terms of links, there is no constraint on the existence of parallel links between a 
pair of enterprise routers. 

Further, it is preferable that the topology not change frequently. If the topology of 
the network changes, then the procedure described herein should be carried out 
afresh. 

For each DS codepoint, the route between every pair of enterprise routers should 
be known. 

The route between every pair of enterprise routers for a given DS codepoint is 
symmetric. 

The delay and jitter characteristics between a pair of routers may be different in 
the two directions. 

In other words, certain of the procedxrres described herein are preferably used 
together with techniques that monitor changes in topology and in routing. Once a 
change in topology or in routing is detected by these techniques, the method according 
15 to an embodiment of the present invention should be performed once again. 

As a consequence of the foregoing manipulations, certain results can be 
deduced. As outlined below, these results include: 

1 . the fact that, for every (R^, Rj) g O, Delay(Ri, R^) can be expressed as a linear 
combination of one or more Delay(Rp, R^), (Rp, R^) e Q; and 

20 2. the fact that the number of router-to-router delay measurements required to 

estimate delay between an arbitrarily specified subset of pairs of routers is at 
most M+N. 

These results are set forth in detail below. 
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First Result 

The first result is determined as follows. Consider the matrix F = [F, F2 . . . 
Fp]^, corresponding to the given set of router pairs in the requirements set, O. Then, 
the minimal subset of pairs of routers, Q, between which delay must be measured is 
5 given by the collection of all pairs of routers, (Rp, R,), that correspond to the maximal 
set of independent rows of F, with respect to {Fk,k= 1,2, Q}. In other words, the 
measurements set can be represented as: 



As a consequence, for every (R^, Rj) e O, Delay(Ri, Rj) can be expressed as a linear 
combination of one or more Delay(Rp, R,), where (Rp, Rq) e Q. 

The above result is illustrated by the following example. Consider the 
network of Fig. 2, where N=6, M=9. If the requirements set, 0) = {(R3, R4) (R3, R5) 
15 (R4 Rfi) (R5, Rfi)} , then from routing table given in Table 1 for a given DS codepoint: 



Q = {(Rp, Rq), such that Delay(Rp, R,) = F^ x, k = 1 , 2, . . . , Q} 



(19) 



10 



20 



zi = Delay(R3, R4) = S3 + d^ + dg + S4 
Z2 = Delay(R3, R5) = S3 + d^ + S5 
Z3 = Delay(R4, R^) = S4 + dg + d, + s^ 
Z4 = Delay(R5, R^) = 85 + ds + Sg 



(20a) 
(20b) 
(20c) 
(20d) 



That is, 



Z= [Zi Z2 Z3Z4]^ = F x 



(20e) 



25 



where 



X = [di, dj. 



dg, Sj, S2, Sg] 



(21) 
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The F matrix is a 4x15 matrix of the form: 





D, 


D2 


D3 


D4 


D5 




Dv 


Ds 


D, 


s, 


S2 


S3 


S4 


S5 
















1 




1 








1 


1 






Z2 












1 












1 




1 




Z3 
















1 


1 








1 




1 


Z4 


















1 










1 


1 



It is verified subsequently herein that Rank(F) = 3, and that Zj, Z3 and Z4 are 
independent row vectors, and that Zj = Zj + Zj - Z4. Thus, the measurements set, Q = 

{(R3,R5),(R4R6X(R5,R6)}- 

Using a different requirements set for network 200, if 

O = {(Ri, R2), (R2, R3). (Ri, R4), (R2, R5), 
(R3, R5), (R3, K), (R4. R5), (R3= Re). (Ri. R3), 

(R^, R,), (R„ R5), (R4, Re), (Ri, Re)} (22) 
the resulting matrix F is 





D, 




D3 


D4 


D5 


D« 




Ds 


D9 


s, 


S2 


S3 


S4 


S5 


85 


Zl 


1 
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1 










Z2 




1 
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Z3 
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1 






1 
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1 
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1 






Z5 
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1 






1 
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Z7 
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Zg 
















1 
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1 




Z9 
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1 




Zio 
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1 
















1 




1 








Zu 




1 
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Z12 
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1 








1 




Zl3 
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1 








1 






Zl4 






1 










1 


1 


1 













It can be shown that the matrix F has rank 13, and that the first 13 rows of F 
are independent. Further, z^^ = x^^ + 2:13 - Zg. Thus Q = {(Ri, R2), (R2. R3). (Ri^ (^2. 
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R,), (R,, (R3, R5), (R3, R^). (R4. (Ri. R3). (R2> R.). (Ri= (R4, R6)}- 

It will be noted that Q is also the subset of measurements required to estimate the 
delay between an arbitrary pair of routers. The second result is now examined. 

Second Result 

5 The minimal subset of pairs of routers, between which delay should be 

measured, so that delay between every other pair of routers can be obtained, can also 
be determined . The number of router-to-router delay measurements required to 
estimate delay between an arbitrarily specified subset of pairs of routers is at most 
M+N. In other words: 

10 

Q = |Q1 - Rank(F) < min(10|, N+M) (23) 

This is so, because the matrix, F, is a \0\ X (M+N), the rank of which, with respect to 
Q, is at most |ct>| or (M+N), whichever is smaller. The theoretical underpinnings of 
1 5 the foregoing results are now examined. 

Theoretical Underpinnings O f The Measurement Scheme 

A measurement scheme according to certain embodiments of the present 
invention, as described herein, makes Q measurements between the collection of Q 
pairs of routers, specified by Q. It will be noted that Q=|Q|, and that Q is the 
20 collection of pairs of routers, (Rp, Rq), that correspond to the maximal set of 

independent rows of F, with respect to {F^, k = 1 , 2, . . . , Q} (i.e., the measurements 
set). 

Network analysis agents (e.g., ANMTs) can be executed, for example, as 
transport applications in two routers, Rj and Rj, to measure round-trip delay and jitter 
25 between R^ and Rj. Such a measurement, denoted y^ yields: 

= Delay(Ri, R^) + v, - s^ + d^ + d^ + ... + d,, + s^ + Vj, (24) 
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It is assxHned that the intermediate links between the two routers are Lp, L^, . . 
L,, that the measiirement error is v^. As noted, processing delays encountered by 
probe packets within source and destination routers, and Rj, respectively, are 
defined as Si and S3, and dp, d^, . . d, are round-trip IP-layer transfer delays 
encountered by probe packets over intermediate links along the route 

link_route(R^, R^) = <Lp, L^, . . . , L > (25) 

The k* measurement, y^,, k = 1, 2, . . Q, of round-trip delay between the k^ pair of 
routers, and Rj, in Q, may be re-written as: 

yi, = Delay(Ri,R3) + Vk = Si + dp + dq+ ... + d,+ s^ + v^, (26) 
= X + Vk 

where the row vector (of size M+N) 

[0 ... 0 1 0 ... 0 1 0 ... 0 1 0 ... 0 1 0 ... 0 1 0 ... 0 ] (27) 

and the 1 's in Fj, appear in columns p, q, . . . , r, and in columns M+i and M+j . The 
following can be defined: 

y-[yiy2...yQf (28a) 

X - [di, d2, .... dM, Si, S2, s^f (28b) 
v=[viV2... VQf (28c) 

where vector y, of size Q, represents the collection of measurements, vector x, of size 
M+N, is the collection of delay components and vector v, of size Q, is the 
measurement error in y. The measurements, y^, k = 1, 2, . . Q, taken together, may 
now be re-written in the form of a vector equation 

y - H X + V (29) 
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where the Q x (M+N) matrix H = [F^^ . . . Fq^]^. Because the k measurements 
correspond to pairs of routers identified by Cl, the row vectors, F^,, k 1 , 2, . . Q, are 
all independent. As a consequence, matrix H has full rank with respect to Q, 

Consider, for example, the network given in Fig. 2, where N=6 and M=9. The 
5 routes between pairs of routers, and Rj, are given in Table 1. Let Q = {(R3, R5) (R4 
R5) (R5, R^)} be the specified subset of pairs between which delay is measured. From 



Table 1, 

Y, = Delay(R3, R5) + v^ = S3 + d, + S5 + v^ (30a) 
10 y2 = Delay(R4, R^) + V2= s^ + dg + dp + s^ + v^ (30b) 

y3 = Delay(R5, R,) + V3 - s^ + d^ + s^ + V3 (30c) 

That is, 

15 y = Hx + v (31) 

where 

y = [yiy2y3f (32a) 

20 

X = [di, dj, . . . , dg, Sj, Sj, . . . , %f (32b) 
V = [Vi (32c) 



25 and 3x1 5 matrix H is: 





D, 


D. 
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D4 


D5 
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Si 
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Y3 
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1 



Calculating Delay Within A Requirements Set Usin^ A Measurements Set 



In this section, a methodology for computing the round-trip delay between 
30 every pair of routers within a given requirements set, (R^, Rj) e O, based on 
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measurements between pairs of routers identified by the measurements set, Q (a 
subset of the requirements set), is described. This approach is particularly useful 
when measurement errors are negligible. 

As previously noted, the delay vector (z) corresponding to the requirements set 
5 is given by 

z = Fx (33) 
while the measurement vector (y) corresponding to the measurements set is given by 

10 

y = Hx (34) 

where 

15 H=[Fi^F/...FqT (35) 

Because {Fj, F2, . . Fq} is the maximal set of independent rows of F, every row 
vector Fk can be expressed as a linear combination of Fj, F2, . - . Fq. 



20 



As a result 

z = Fx = AHx (36a) 



where 

25 A=[IaY (36b) 

and the row vectors a^, k = Q+1, Q+2, ... P are used to express ¥^ in terms of F^, F2, 
. . Fq (as discussed above with regard to Equation (13)). 

30 The following provides a technique for allowing the network's operator to 

control (at least to some extent) which routers and links are involved in the 
measurements thus taken. 
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A Preferred Measurements Set 

Depending upon the order in which the pairs of routers in the requirements set 
(O) are listed and processed, one of many possible measurements sets can result. The 
set of router pairs between which measurements are made is dependent (at least in 
5 part) on the ordering of the requirements set. The specific measurements set sought is 
the one that requires measurements to be made between one or more preferred set of 
router pairs. For example, in a given network, and let 

(D = {(Ri, R2), (R,, R3), (Ri, R4), (Ri, R5), (Ri. R.). (Ru R7). (R2, R3), (R2, 
10 R4), R5). (R2, R^), (R2, R7), (R3, R4), (R3, R5). (R3. KX (R3. R7)} 

Given the option, an operator of such a network would prefer to use the measurement 
set: 

15 {(Ri, R2I (Ri. R3), (Ri. R4), (Ri, R5), (Ri. R6). (Ri. R7). (R4, R2)} 

instead of 

= {(Ri, R2), (Ri, R3). (Ri, R5). (Ri, R^). (Ri. R7). (R2. R7). (R3. R4)} 

20 

because the former set, Q,\ requires that measurements be initiated from Rj and Rj 
only, while the latter, Q^, requires that measurements be initiated from R^, Rj, and R3. 
The former measurements set is thus referred to herein as a preferred measurements 
set, although such a measvirements set can be referred to as a measurements set for the 
25 sake of simplicity. 

A General Procedure For Employing An Ordered Measurements Set In Determining 
Delay For A Requirements Set 

A procedure to deterministically compute the round-trip delay between pairs 
of routers, given by O, from measured round-trip delay between the Q number of 
30 ordered pairs of routers, identified by Q, can be defined using the preceding results. 
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As can be seen, the computed round-trip delay, A, between the P pairs of routers in O 
is given by 

A = Ay (37) 

5 

where yj,, k = 1, Q, are delay measurements between the Q pairs of routers in 
and Aj J ^ 1, 2, . . . , P, are delay between the P pairs of routers in O . 

Fig. 3 illustrates a process of deterministically computing the round-trip delay 
between preferred pairs of routers. The process begins with the specification of the 

10 requirement set (step 300). Next, the router pairs in the requirements set are ordered 
in order to effect the operator's desires as to the ordering of the preferred 
measurements set (step 310). Delay components are then determined, and the delay 
components vector (x) constructed (step 320), Next, the F matrix is determined from 
the given requirements set and routing table (step 330). Once the F and x matrices 

1 5 have been constructed, the preferred measurements set, the F matrix's rank (Q) and 
the A matrix are calculated by performing the procedure preferred_measurements_set 
(step 340), 

Preferred_measurements_set performs functions such as determining the 
maximal set of independent rows of F, viz. Fj, F2, . . Fq, in part by determining the 

20 rank of F (denoted herein by Q); constructing the A matrix by determining 1, 
aK2? •? ock^q], such that Fk = Si=i,...,q (oCk^i Fi); and determining the preferred 
measurements set, Q. Once the preferred measurements set is thus constructed, 
average round-trip delay, y^, and delay-jitter, y^, are measured between the pair of 
routers, % = (R4, R^), k = 1,2, . . ., Q, using a network management tool (e.g., ANMT) 

25 (step 350). Once these measurements have been obtained, the round-trip delay for 
router pairs in O can be estimated and the round-trip delay vector, Aj,, constructed 
(step 360). In a similar fashion, round-trip delay-jitter, u^, can be computed for router 
pairs in O (step 370). The process of taking measurements, and estimating and 
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computing delay and delay-jitter, respectively, can then be repeated for subsequent 
time intervals, in order to collect more data regarding delay and delay-jitter. 

The above process may be summarized as follows: 
BEGIN 

Specify the requirements set, O; 
Order the requirements set, O; 

Identify the N+M delay components and construct the resulting delay- 
components vector, x; 

Determine F matrix from the given requirements set, and the routing table; 

Perform "preferred_measurements_set" to: 

Determine maximal set of independent rows of F, viz. F^, F2, . . Fq; 

Determine 1, aK2. •••3 <^k,q]^ such that Fk = 21^=1 q (aKj FJ ; and 

Determine the preferred measurements set, Q; 
Measure round-trip delay and delay-jitter between router pairs in Q, and 
organize them as y and c; respectively 

Estimate round-trip delay using the equation A = Ay; 
Compute round-trip delay-jitter. 

END 

Measxirement error is preferably kept to a negligible level. 

Each of the blocks of the flow diagram of Fig. 3, and those depicted in 
subsequent figures, may be executed by a module (e.g., a software module) or a 
portion of a module or a computer system user. The methods described herein, the 
operations thereof and modules for performing such methods may therefore be 
executed on a computer system configured to execute the operations of the method 
and/or may be executed from computer-readable media. The method may be 
embodied in a machine-readable and/or computer-readable medium for configuring a 
computer system to execute the method. The software modules may be stored within 
and/or transmitted to a computer system memory to configure the computer system to 
perform the functions of the module. Alternatively, such actions may be embodied in 
the structure of circuitry that implements such functionality, such as the micro-code of 
a complex instruction set computer (CISC), firmware programmed into programmable 
or erasable/programmable devices, the configuration of a field-programmable gate 
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array (FPGA), the design of a gate array or full-custom application-specific integrated 
circuit (ASIC), or the like. 

Those skilled in the art will also recognize that the boundaries between 
modules and operations depicted herein are merely illustrative and alternative 

5 embodiments may merge such modules or operations, or impose an alternative 
decomposition of functionality thereon. For example, the actions discussed herein 
may be decomposed into sub-operations to be executed as multiple computer 
processes. Moreover, altemative embodiments may combine multiple instances of a 
particular operation or sub-operation. Furthermore, those skilled in the art will 

10 recognize that the operations described in exemplary embodiment are for illustration 
only. Operations may be combined or the functionality of the operations may be 
distributed in additional operations in accordance with the invention. As vnll also be 
apparent to those of skill in the art, methods for determining delay and jitter described 
herein may employ other techniques (similar in effect to those described herein) to 

15 make such determinations, and such altemative techniques are intended to be 
comprehended by the methods and apparati discussed herein. 

A Formalized Description Of A Method For Calculating Delay And Jitter Within A 
Requirements Set Using A Preferred Measurements Set 

A procedure according to a method of the present invention that computes the 
20 round-trip delay and delay-jitter between every pair of routers in the requirements set 
(using every router pair = (R^, R,) e O) using measurements between pairs of 
routers identified by the ordered router pairs of a preferred measurements set, Q, is 
now described using a formal syntax. The scheme is particularly useful when the 
measurement errors are small and no a priori delay measurements are available. 
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BEGIN 

1"^ The following procedxire assumes that the topology and routing table, */ 

for a given DS codepoint, is known. Where necessary, this procedure */ 
is executed for each DS codepoint under consideration. 

/* If the network topology and/or the routing changes, this procedure ""I 

/* should be executed afresh with the new topology or new routing table. */ 

/* Specify the collection of pairs of routers */ 
3>TCMP^ {%=(Ri. R^Xk- 1,2, ...,P}; 

/* Call order_requirements__set to order the pairs of routers in */ 

/* the requirements set 

O = order_requirements_set (O-i^mp); 

/* Identify the N+M delay components, viz. link-level IP transfer delay, */ 
/* di, I = 1 , 2, . . . , M, and ANMT processing delay, Sj j - 1 , 2, . . . , N, and */ 
Construct the resulting delay-components vector (M-vector, x) */ 
x= [di. dM, Sj, $2, Sn]^; 

For each k^ 1, 2, P, { 

Identify the pair of routers % = (Ri, Rj), tTj, e O; 
Obtain the route link_path(R^, Rj) = <Lp, L^, ., L >; 
Determine the row vector, F^, such that ^ Delay(Ri, Rj) = Fj. x 

}; 

Construct the P x (N+M) matrix, F; 

/* Call "preferred_measurements_set" to: 

/* Determine the maximal set of independent rows of F, viz. F^, F2, . . Fq 
/* Determine [aK 1, aK,2, .... oCkq]. such that Fk = 2^i=i,...,Q (o^Ki Fj) */ 
Determine the preferred measurements set, Q. */ 

(Q, Q, OkC K = Q+1, . . P)) = preferred__measurements_set (F, A, O); 

/* Identify the start time, to, and the measurement interval, dt '^1 

to = start_time; 

dt = measurement_interval; 

While (IfmishedO) { 

if (current-time > to) 

For each k== 1, 2, Q, { 

Measure average round-trip delay, y^, and delay-jitter, 

Yj^, between the pair of routers, % = (Ri, Rj) using a 
network management tool (e.g., ANMT) 
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}; 

/* Compute round-trip delay vector, A^, for each pair of routers in O */ 
5 For each router pair in { 

For each k= 1, 2, ...^ { 

}; 

For eachk = Q+l,Q+2, ...,P, { 
10 Ak = i:i.i,...,Q (ak,i Yi) 

} 

}; 

/* Compute round-trip delay-jitter, a^, for each pair of routers in O */ 
1 5 For each router pair in O { 

For eachk= 1, 2, Q, { 

}; 

For each k = Q+l,Q+2, ...,P, { 
} 

}; 

to==to+dt 
} 



25 



END 



In the above procedure, the call to finishedQ is made to determine if the number of 
measurements and estimations made are sufficient in the given situation. As noted, 
30 the above scheme is applicable where no other delay measvirements or a priori 
estimates are available and assumes that the measurement error is negligible. 

Operation of order requirements set 

Fig. 4 is a flow diagram that describes, in general terms, the operation of 
order_requirements_set. From the given requirements set, O, the collection of 
35 routers, 91, for which delay and jitter estimates are required, is identified (step 400). 
Once these routers identified, a preference is assigned to each router (step 410). Next, 
for each router pair in O (step 420), the first router of the current router pair is 
compared to the second router of the current router pair (step 430). If the second 
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router of the current router pair is preferred over the first router of that router pair 
(step 430), the routers are re-ordered (i.e., swapped) (step 440). Elements tIk = (R,, 
Rj) e O are then sorted on the two keys, with regard to pref(R4) and pref(Rj) (step 
450), such that the following relationships exists: 

5 

Assuming (tiki = (R,i, Rji) and tTkj = (Ri2, Rj2)) (3 8) 

if (pref(R,i) o pref(Ri2)), then pref(RiO < pref(R,2) 
if (pref(Ri,) == pref(Ri2)), then pref(R^i) < pref(R32) 

10 These operations can be expressed more formally in the following manner. 
BEGIN 

/* From the given requirements set, identify the collection of */ 
15 /* enterprise routers, 91, for which delay and jitter estimates are */ 

/* required. */ 

= u Ri, such that for some Rj, = (R,, R,) g <D or tTk = (Rj, Ri) e O; 

20 /* Assign preference to each router */ 

For all Rj G 91 { 

pref(Ri) = u, ue {1,2, ...,2P} 

}; 

25 /* Re-order each pair of router in O */ 

For all TtK = (Rj, Rj) G O { 

If(pref(R,)>pref(R3)){ 

7CK = (R,,Ri) 
30 } 
} 



35 



40 



Sort elements = (R^, Rj) g O on the two keys, pref(Ri) and pref(Rj), 
such that the following condition is true: 

For (TtK, = (Rii, Rji) and n^^ = (Ri2, ^2)) && (tiki, ^ O)) { 
if (pref(Rii) o pref(Ri2)), then pref(Ri,) < pref(R,2); 
if (pref(Rii) = pref(Ri2)), then pref(Rj,) < pref(Rj2) 
} 
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Operation of preferred measurements set 

The procedure preferred_measurements_set performs an LU decomposition of 
matrix F using, for example, Gaussian elimination. The use of Gaussian elimination 
is merely exemplary, and other methods providing similar results will be apparent to 
those of skill in the art. Using Gaussian elimination to perform the decomposition, for 
example, a system of linear algebraic equations, such as 

F(M)Xi+F(i,,)X, + F^i,3)X3-bi (39a) 
F(2 1) xi + F(2,2) X2 + F(2,3) X3 = b, (39b) 
F(3,i) X, + F(3,2) X2 + F(33) X3 = b3 (39c) 

can be re-written as 

Fx = b (40) 

where F is a 3x3 matrix with elements, F^y),, and x and b are the column vectors 

x^=[x,X2X3] (41) 
b^ = [b,b2b3] (42) 

The set of equations have a unique solution provided that the matrix F is non-singular. 
In other words, the set of equations have a unique solution provided that the row 
vectors, 

F.^ = [F,,)F,,, F,,3,] (43a) 
F/ = [F,,,>F,,„F(,,3)] 43b) 
F3"=[F(3,i) F(3.2) F(3,)] (43c) 

are independent. Once this constraint is met, Gaussian elimination may be used to 
obtain a 3x3 matrix, A, such that 

AF = F (44) 
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where F' is an upper triangular matrix. The fact that F' is an upper triangular matrix 
implies that the system of equations 

AFx = F'x = Ab (45) 

can be solved by back substitution. The algorithm to obtain a matrix A (equivalently 
F') can be described as follows: 

A = I; 1^ where I is the n x n identity matrix */ 

for 1 ton -1 { 

for i = k to n { 

Fi - -(F(i,k) /F(k,k)) Fk + F^; /* These are row vector 

operations. The operation may be 
limited to elements in columns k, 
k+1, ...,n*/ 

A = -(F(i,k) /F(k,k)) Ak + Ai /* The operation must be applied 

to elements in columns 1 , 2, . . . , n 

*/ 

} 



It will be noted that Gaussian elimination may also be used to detect whether the 
system of equations is solvable, or equivalently, whether the row vectors of F are 
Unearly independent. A dependent row of F can inamediately be detected as soon as it 
is discovered that a pivot element (F^^^k), the procedure) is zero. In fact, at any point 
in the process, if F^^) = 0^ then the row is a linear function of Fj, F2, . . F^.i. The 
dependence between row F^ and F^, F2, . . . , F^.i is captured by (and reflected in) the 
corresponding row in matrix A. 

As part of the process of preferred__measurements_set, a sequence of lower- 
triangular matrices A\ A^ A^ is constructed to obtain a sequence of upper- 
triangular matrices F^ = A^ F, F' = A' F, . . . , F^ A^ F. If at any stage the row of the 
matrix F*" is zero, i. e. F^j = 0, for some j > k, then F^ is linearly dependent upon F^, F2, 
. . ., Fk because F^j = 0 implies: 

AV,i) Fi + AV,2) F.+ . . . + AV,) F,,i+ V, = 0 (46) 
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The foregoing forms the basis of the procedure preferred_measurements_set, which is 
now described in greater detail. 

Fig. 5 is a flow diagram that describes, in general terms, the operation of 

5 preferred_measurements_set for a given requirements set, d) = {tIk = (Rj, Rj), k = 1 , 2, 
. . . , P} , and the corresponding P x (N+M) matrix F. First, the A matrix is set to 
identity matrix (I) (step 500). For each row up to the last independent row (step 505), 
the following actions are performed. The next non-zero row of F is identified, if there 
is such a row that still has not been examined (step 5 1 0). If such a row is successfully 

10 identified (i.e., Fj ^ 0) (step 5015), the rows of F are re-arranged (step 520). 

Corresponding rows and columns of A are also re-arranged, as are pairs of routers in 
O (steps 525, 530 and 535). At this point in the process, row Fj, 0. The 
corresponding non-zero element (F^^jj^^ 0) is then found (step 540). Once the F matrix 
and X matrix have been prepared for pivoting (by ensuring that pivot Y^^) 0) (step 

1 5 545), a pivot operation is performed on the F matrix (step 550). A pivot operation is 
also performed on the A matrix (step 555). At this point the value of Q (the number 
of independent rows (i.e., rank) of F is known, and the for Q rows of F are 
independent. Thus, the preferred measurements set can then be populated with the 
router pairs corresponding to the independent rows of F (step 560). Vectors that allow 

20 the non-independent rows of F to be described in terms of the independent rows of F 
(aK,K = Q+1, . . ., P) are then defined (step 565). Finally, values for Q, Q, and Kk (k = 
Q+1, P) are returned (step 570). The preceding process can be expressed more 
formally in the following manner. 
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BEGIN 

/* Matrix A is set to the identity matrix (I) */ 
for i = 1 to P { 

forj = 1 toP { 

if(i==j){ 

A(i j) = 1 

} 

else { 

A(ij) = 0 
} 

} 

}; 

row_zero__at = P+1 ; 

while (k < row_zero_at - 1) { 
j=k; 

/* Once the following is completed, either j has progressed to */ 
/* row_zero_at,or Fj is non-zero (i.e., ^ 0) */ 
while ((Fj = 0) && 0 < row__zero_at)) { 

}; 

if ((Fj o 0) && 0 < row_zero_at)) { 

Rearrange rows of F, and (correspondingly) rows and 
/* columns of A, and pairs of routers in O. */ 

(1) interchaiige_matrix_rows (MATRIX, FROM, TO */ 
/* exchanges the FROM and TO rows of MATRIX 
/* (2) interchange_matrix_columns (MATRIX, FROM, TO)*/ 
/* exchanges corresponding columns of MATRIX */ 
/* (3) interchange_router_pairs (SET, I, J) */ 

exchanges router pairs I & J 



torow = k; 

for i j to (row_zero_at - 1) { 

interchange_matrix_rows (F, i, to_row); 
interchange_matrix_rows (A, i, to_row); 
interchange_matrix_columns (A, i, to_row); 
interchange_router_pairs (O, i, to_row); 
to_row = to_row +1 

} ; At this stage, row F^^O. */ 
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10 



15 



20 



25 



30 



35 



row_zero_at = to_row; 
while F(kj) 0 { 

}; 



/"^ At this stage, F(kj)^0. 



The following ensxires that pivot F^^J^y ^ 0. 
/* Once completed, pivoting may be carried out. 
interchange_matrix_coliimns(F, k, j); 
interchange_vector_elements(x, k, j); 

/* Undertake pivot operation 
if k < ro wzeroat then 

for all i k+1 to row_zero_at - 1 { 

/* These are row vector operations. 
/* The operation may be limited to elements in 
/* columns k, k+1, M 
F--(F(i,u)/F(k,k))Fu + Fi; 

/* The operation must be applied to elements in 

columns 1, 2, P 
Ai = -(F(i3,)/F(k^))Ak + A,; 
} ; /* This completes the pivot operation. 



else { 



k-k+l 
} 

rowzeroat = k 
} 



/* i.e., for the remaining Fj = 0. 
End of outer while loop 



40 



Q - row zero at -1 ; 

for K = 1 to Q { 

add_to_set(Q, %k) 

}; 

forK = Q+l toP { 

}; 

retum(Q, CI, a^, k = Q+1, . . P) 



*/ 



*/ 



*/ 
*/ 



/* Req'd to ensure Fk = .._q (aKi Fj) */ 



END 
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A Measurement Example Using a Preferred Measurements Set 

Fig. 6 is a block diagram depicting an exemplary enterprise network 600 in 
which a measurement and estimation technique according to the present invention can 
be employed to estimate delay and delay-jitter. Enterprise network 600 includes a 
backbone 610 and routers 620(l)-(7). Routers 620(l)-(7) are coupled to backbone 
610 by links 630(l)-(7), respectively. It will be noted that routers 620(l)-(7) are also 
designated R^, i - 1, 2, . . 7, and that links 630(l)-(7) are also designated L(ij), i 1, 2, 
3, 4, and j = 1, 2, 3, in order to allow network 600 to be discussed in terms of the 
parameters discussed herein. Additionally, backbone 610 includes backbone routers 
640(l)-(4), with backbone router 640(1) coupled to backbone routers 640(2), 640(3) 
and 640(4) by backbone links 650(1), 650(2) and 650(3), respectively. It will be 
noted that backbone routers 640(l)-(4) are also designated pi, i = 1, 2, 3,4, 
respectively, and that backbone links 650(1 )-(3) are also designated A^^u), j = 1, 2, 3, 
respectively, in order to allow network 600 to be discussed in terms of the parameters 
discussed herein. It is desirable to determine, or at least estimate, the delay and delay- 
jitter experienced by network traffic flowing through enterprise network 600. This 
information may be derived using the techniques just described. 

To begin, let the requirements set be 

o = {(Ri, R2), (Ri. R3), (Ru R4). (Ri. R5). (Ri. R^). (Ri. R7). 

(R„ R3), (R2, R4), (R2, R5), (R2, Re). (R2. R7). 

(R3, R4), (R3, R5), (R3, R6). (R3, R7)} (47) 

The various actions performed when estimating delay and delay-jitter using a 
preferred measurements set are now described. 
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First, the operator assigns priorities to one or more of the routers in the 
collection of enterprise routers, 91 = {Rj, Rj, R3, Rt, ^5, R*, R?}- For example, the 
assigned priorities can be, in decreasing priority, R„ R4, R5, R^, Rj, R3, R?- The pairs 
of routers are re-ordered as follows: 

5 

o = {(R„ R2), (Ri, R3), (R„ R4), (Ri, R5), (Ri, R^), (Ri, R7), 
(R2, R3), (R4, R2), (R5, R2), (R6, R2), (R2, R7), 
(R,, R3), (R5, R3), (R., R3), (R3, R7)} (48) 



10 The set, O, when sorted on the two keys, pref(Ri) and pref(Rj) resiilts in: 



O = {(R„ R2), (Ri, R3), (Ri, R4), (Ri, R5), (Ru Re), (Ri, R7), 
(R4, R2), (R4, R3), (R5, R2), (R5, R3), (R6= R2), (R6, R3), 
(R„ R3), (R2, R7), (R3, R7)} (49) 

15 

Next, the N+M- vector, x, of delay components is determined 



X = [di„ di2, di3, dji, d3i, d4i, d42, C,2, 0,3, C14, Su, S12, Si3, S21, S31, S41, S42]^ (50) 



20 The resulting F matrix ia a 1 5x1 7 matrix of the form: 
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Initially, the pivot element is F(l,l)- As a result matrix F is: 
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The next pivot element is F(2,2). As a result matrix F is: 
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0 


-1 




0 


0 


0 


0 


y3 


0 


0 




1 


0 


0 


0 


1 


0 


0 


0 


0 




1 


0 


0 


0 


y4 


0 


0 




0 


1 


0 


0 


0 


1 


0 


0 


0 




0 


1 


0 


0 


y5 


0 


0 




0 


0 


1 


0 


0 


0 


1 


0 


0 




0 


0 


1 


0 


y6 


0 


0 




0 


0 


0 


1 


0 


0 


1 


0 


0 




0 


0 


0 


1 


yi 


0 


0 




1 


0 


0 


0 


1 


0 


0 


0 


0 




1 


0 


0 


0 


yS 


0 


0 




1 


0 


0 


0 


1 


0 


0 


0 


0 




1 


0 


0 


0 


y9 


0 


0 




0 


1 


0 


0 


0 


1 


0 


0 


0 




0 


1 


0 


0 


ylO 


0 


0 




0 


1 


0 


0 


0 


1 


0 


0 


0 




0 


1 


0 


0 


yll 


0 


0 




0 


0 


1 


0 


0 


0 


1 


0 


0 




0 


0 


1 


0 


yi2 


0 


0 




0 


0 


1 


0 


0 


0 


1 


0 


0 




0 


0 


1 


0 


yl3 


0 


0 




0 


0 


0 


0 


0 


0 


0 


0 


0 




0 


0 


0 


0 


yl4 


0 


0 




0 


0 


0 


1 


0 


0 


1 


0 


0 




0 


0 


0 


1 


yl5 


0 


0 




0 


0 


0 


1 


0 


0 


1 


0 


0 




0 


0 


0 


1 
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The next pivot element is F(3,3). As a result matrix F is: 





dll 


dl2 


dl3 


d21 


d31 


d41 


d42 


C12 


C13 


C14 


sU 


si2 


sl3 


s21 


s31 


s41 


s42 


yi 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


y3 


0 


0 


-1 


1 


0 


0 


0 


1 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


y4 


0 


0 


0 


-1 


1 


0 


0 


-1 


1 


0 


0 


0 


0 


-1 


1 


0 


0 


y5 


0 


0 


0 


-1 


0 


1 


0 


-1 


0 


1 


0 


0 


0 


-1 


0 


1 


0 


y6 


0 


0 


0 


-1 


0 


0 


1 


-1 


0 


1 


0 


0 


0 


-1 


0 


0 


1 


y7 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


0 


0 


y8 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


0 


0 


y9 


0 


0 


0 


1 


1 


0 


0 


1 


1 


0 


0 


0 


0 


1 


1 


0 


0 


ylO 


0 


0 


0 


1 


1 


0 


0 


1 


1 


0 


0 


0 


0 


1 


1 


0 


0 


yll 


0 


0 


0 


1 


0 


1 


0 


1 


0 


1 


0 


0 


0 


1 


0 


1 


0 


yl2 


0 


0 


0 


1 


0 


1 


0 


1 


0 


1 


0 


0 


0 


I 


0 


I 


0 


yl3 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


0 


0 


yl4 


0 


0 


0 


1 


0 


0 


1 


1 


0 


1 


0 


0 


0 


I 


0 


0 


1 


yl5 


0 


0 


0 


1 


0 


0 


1 


1 


0 


1 


0 


0 


0 


1 


0 


0 


1 



The next pivot element is F(4,4). As a result matrix F is: 

5 





dll 


dl2 


dl3 


d21 


d31 


d41 


d42 


C12 


C13 


C14 


sll 


sl2 


sl3 


s21 


s31 


s41 


s42 


yi 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


y3 


0 


0 


-1 


1 


0 


0 


0 


1 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


y4 


0 


0 


0 


-1 


1 


0 


0 


-1 


1 


0 


0 


0 


0 


-1 


1 


0 


0 


y5 


0 


0 


0 


0 


-1 


1 


0 


0 


-1 


1 


0 


0 


0 


0 


-1 


1 


0 


y6 


0 


0 


0 


0 


-1 


0 


1 


0 


-1 


1 


0 


0 


0 


0 


-1 


0 


1 


yi 


0 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


0 


y8 


0 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


0 


y9 


0 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


0 


ylO 


0 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


0 


yll 


0 


0 


0 


0 


1 


1 


0 


0 


1 


1 


0 


0 


0 


0 


1 


1 


0 


yl2 


0 


0 


0 


0 


1 


1 


0 


0 


1 


1 


0 


0 


0 


0 


1 


1 


0 


yl3 


0 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


0 


yl4 


0 


0 


0 


0 


1 


0 


1 


0 


1 


1 


0 


0 


0 


0 


1 


0 


1 


yl5 


0 


0 


0 


0 


1 


0 


1 


0 


1 


1 


0 


0 


0 


0 


1 


0 


1 
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The next pivot element is F(5,5). As a result matrix F is: 





dll 


dl2 


dl3 


d21 


d31 


d41 


d42 


C12 


C13 


C14 


sll 


sl2 


sl3 


s21 


s31 


s41 


s42 


yi 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


y3 


0 


0 


-1 


1 


0 


0 


0 


1 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


y4 


0 


0 


0 


-1 


1 


0 


0 


-1 


1 


0 


0 


0 


0 


-1 


1 


0 


0 


y5 


0 


0 


0 


0 


-1 


1 


0 


0 


-1 


1 


0 


0 


0 


0 


-1 


1 


0 


y6 


0 


0 


0 


0 


0 


-1 


1 


\) 


u 




n 
u 


Q 


0 


0 


0 


-1 


1 


y7 


0 


0 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


y8 


0 


0 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


y9 


0 


0 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


ylO 


0 


0 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


yll 


0 


0 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


yl2 


0 


0 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


yl3 


0 


0 


0 


0 


0 


2 


0 


0 


0 


2 


0 


0 


0 


0 


0 


2 


0 


yl4 


0 


0 


0 


0 


0 


1 


1 


0 


0 


2 


0 


0 


0 


0 


0 


1 


1 


yl5 


0 


0 


0 


0 


0 


1 


1 


0 


0 


2 


0 


0 


0 


0 


0 


1 


1 



The next pivot element is F(6,6). As a resuh matrix F is: 





dll 


dl2 


dl3 


d21 


d31 


d41 


d42 


C12 


C13 


C14 


sll 


sl2 


sl3 


s21 


s31 


s41 


s42 


yi 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


y3 


0 


0 


-1 


1 


0 


0 


0 


1 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


y4 


0 


0 


0 


-1 


1 


0 


0 


-1 


1 


0 


0 


0 


0 


-1 


1 


0 


0 


y5 


0 


0 


0 


0 


-1 


1 


0 


0 


-1 


1 


0 


0 


0 


0 


-1 


1 


0 


y6 


0 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


-1 


1 




0 


0 


0 


0 


0 


0 


2 


0 


0 


2 


0 


0 


0 


0 


0 


0 


2 


yS 


0 


0 


0 


0 


0 


0 


2 


0 


0 


2 


0 


0 


0 


0 


0 


0 


2 


y9 


0 


0 


0 


0 


0 


0 


2 


0 


0 


2 


0 


0 


0 


0 


0 


0 


2 


ylO 


0 


0 


0 


0 


0 


0 


2 


0 


0 


2 


0 


0 


0 


0 


0 


0 


2 


yll 


0 


0 


0 


0 


0 


0 


2 


0 


0 


2 


0 


0 


0 


0 


0 


0 


2 


yl2 


0 


0 


0 


0 


0 


0 


2 


0 


0 


2 


0 


0 


0 


0 


0 


0 


2 


yl3 


0 


0 


0 


0 


0 


0 


2 


0 


0 


2 


0 


0 


0 


0 


0 


0 


2 


yl4 


0 


0 


0 


0 


0 


0 


2 


0 


0 


2 


0 


0 


0 


0 


0 


0 


2 


yl5 


0 


0 


0 


0 


0 


0 


2 


0 


0 


2 


0 


0 


0 


0 


0 


0 


2 
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The next pivot element is F(7,7). As a result matrix F is: 





dll 


dl2 


dl3 


d21 


d31 


d41 


d42 


C12 


C13 


C14 


sll 


sl2 


sl3 


s21 


s31 


s41 


s42 


yi 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


y3 


0 


0 


-1 


1 


0 


0 


0 


1 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


y4 


0 


0 


0 


-1 


1 


0 


0 


-1 


1 


0 


0 


0 


0 


-1 


1 


0 


0 


y5 


0 


0 


0 


0 


-1 


1 


0 


0 


-1 


1 


0 


0 


0 


0 


-1 


1 


0 


y6 


0 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


-1 


1 


y7 


0 


0 


0 


0 


0 


0 


2 


0 


0 


2 


0 


0 


0 


0 


0 


0 


2 


y8 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y9 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


ylO 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yll 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yl2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yl3 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yl4 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yl5 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



Since the remaining row vectors of F are 0, the algorithm terminates. 

The sequence of resulting 15x15 A matrices are given below. Initially, the A 
matrix is: 





yi 


y2 


y3 


y4 


y5 


y6 


y7 


y8 


y9 


ylO 


yll 


yl2 


yl3 


yl4 


yl5 


yi 


1 






























y2 




1 




























y3 






1 


























y4 








1 
























y5 










1 






















y6 












1 




















y7 














1 


















y8 
















1 
















y9 


















1 














ylO 




















1 












yll 






















1 










yl2 
























1 








yl3 


























1 






yl4 




























1 




yl5 






























1 
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Using the pivot F(l,l), matrix A is: 





yi 


y2 


y3 


y4 


y5 


y6 


yi 


yS 


y9 


ylO 


yll 


yl2 


yl3 


yl4 


yl5 


yi 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y3 


-1 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y4 


-1 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y5 


-1 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y6 




0 


0 


0 


0 


1 


0 


A 

u 


u 


u 


n 
u 


u 


u 


u 


Q 


y7 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


y8 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


y9 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


ylO 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


yll 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


yl2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


yl3 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


yl4 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


yi5 


0 


0 


0 


0| 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 



Using the pivot F(2,2), matrix A is: 

5 





yi 


y2 


y3 


y4 


y5 


y6 


y7 


y8 


y9 


ylO 


yll 


yi2 


yl3 


yl4 


yl5 


yi 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y3 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y4 


0 


-1 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y5 


0 


-1 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y6 


0 


-1 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y7 


-1 


1 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


y8 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


y9 


-1 


1 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


ylO 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


yll 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


yl2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


yl3 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


yl4 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


yl5 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 0 


0 


1 
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Using the pivot F(33)? matrix A is: 





yi 


y2 


y3 


y4 


y5 


y6 


y7 


y8 


y9 


ylO 


yll 


yl2 


yl3 


yl4 


yl5 


yi 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y3 


0 


-1 




0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y4 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y5 


0 


0 


-1 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y6 


0 


0 




0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yi 


-1 


0 




0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


yS 


0 


-1 




0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


y9 


-1 


0 




0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


ylO 


0 


-1 




0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


yll 


-1 


0 




0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


yl2 


0 


-1 




0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


yl3 


-1 


-1 




0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


yl4 


-1 


0 




0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


yl5 


0 


-1 




0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 



Using the pivot F(4,4), matrix A is: 

5 





yi 


y2 


y3 


y4 


y5 


y6 


y7 


y8 


y9 


ylO 


yll 


yl2 


yi3 


yl4 


yl5 


yi 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y3 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y4 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y5 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y6 


0 


0 


0 


-1 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y7 


-1 


0 


-1 


2 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


yS 


0 


-1 


-1 


2 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


y9 


-1 


0 


0 


1 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


ylO 


0 


-1 


0 


1 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


yll 


-1 


0 


0 


1 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


yl2 


0 


-1 


0 


1 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


yl3 


-1 


-1 


0 


2 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


yl4 


-1 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


yl5 


0 


-1 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 
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Using the pivot F(5,5), matrix A is: 





yi 


y2 


y3 


y4 


y5 


y6 


y7 


y8 


y9 


ylO 


yil 


yl2 


yl3 


yl4 


yl5 


yi 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


-1 


I 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y3 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y4 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y5 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y6 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y7 


-1 


0 


-1 


0 


2 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


y8 


0 


-1 


-1 


0 


2 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


y9 


-1 


0 


0 


-1 


2 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


ylO 


0 


-1 


0 


-1 


2 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


yll 


-1 


0 


0 


0 


1 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


yl2 


0 


-1 


0 


0 


1 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


yl3 


-1 


-1 


0 


0 


2 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


yl4 


-1 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


yl5 


0 


-1 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 



Using the pivot F(6,6), matrix A is: 

5 





yi 


y2 


y3 


y4 


y5 


y6 


y7 


yS 


y9 


ylO 


yll 


yl2 


yl3 


yl4 


yl5 


yi 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y3 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y4 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y5 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y6 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y7 


-1 


0 


-1 


0 


0 


2 


1 


0 


0 


0 


0 


0 


0 


0 


0 


y8 


0 


-1 


-1 


0 


0 


2 


0 


1 


0 


0 


0 


0 


0 


0 


0 


y9 


-1 


0 


0 


-1 


0 


2 


0 


0 


1 


0 


0 


0 


0 


0 


0 


ylO 


0 


-1 


0 


-1 


0 


2 


0 


0 


0 


1 


0 


0 


0 


0 


0 


yll 


-1 


0 


0 


0 


-1 


2 


0 


0 


0 


0 


1 


0 


0 


0 


0 


yl2 


0 


-1 


0 


0 


-1 


2 


0 


0 


0 


0 


0 


1 


0 


0 


0 


yl3 


-1 


-1 


0 


0 


0 


2 


0 


0 


0 


0 


0 


0 


1 


0 


0 


yl4 


-1 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


1 


0 


yi5 


0 


-1 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


1 
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Using the pivot F(7,7), matrix A is: 





yi 


y2 


y3 


y4 


y5 


y6 


y7 


y8 


y9 


ylO 


yll 


yl2 


yl3 


yl4 


yl5 


yi 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y3 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y4 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y5 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y6 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yv 


-1 


0 


-1 


0 


0 


2 




0 


0 


0 


0 


0 


0 


0 


0 


ys 


1 


-1 


0 


0 


0 


0 




1 


0 


0 


0 


0 


0 


0 


0 


y9 


0 


0 


1 


-1 


0 


0 




0 


1 


0 


0 


0 


0 


0 


0 


ylO 


1 


-1 


1 


-1 


0 


0 




0 


0 


1 


0 


0 


0 


0 


0 


yll 


0 


0 


1 


0 


-1 


0 




0 


0 


0 


1 


0 


0 


0 


0 


yl2 


1 


-1 


1 


0 


-1 


0 




0 


0 


0 


0 


1 


0 


0 


0 


yl3 


0 


-1 


1 


0 


0 


0 




0 


0 


0 


0 


0 


1 


0 


0 


yl4 


0 


0 


1 


0 


0 


-1 




0 


0 


0 


0 


0 


0 


1 


0 


yl5 


1 


-1 


1 


0 


0 


-1 




0 


0 


0 


0 


0 


0 


0 


1 



Thus, using the procedure preferred_measurements_set, the resulting 15x17 matrix F' 
is: 





dll 


dl2 


dl3 


d21 


d31 


d41 


d42 


C12 


C13 


C14 


sll 


sl2 


sl3 


s21 


s31 


s41 


s42 


yi 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y2 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


y3 


0 


0 


-1 


1 


0 


0 


0 


1 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


y4 


0 


0 


0 


-1 


1 


0 


0 


-1 


1 


0 


0 


0 


0 


-1 


1 


0 


0 


y5 


0 


0 


0 


0 


-1 


1 


0 


0 


-1 


1 


0 


0 


0 


0 


-1 


1 


0 


y6 


0 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


-1 


1 


yi 


0 


0 


0 


0 


0 


0 


2 


0 


0 


2 


0 


0 


0 


0 


0 


0 


2 


yS 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y9 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


ylO 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yll 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yl2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yl3 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yl4 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yi5 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 
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and the 1 5x1 5 A matrix is: 





yi 


y2 


y3 


y4 


y5 


y6 


y7 


yS 


y9 


ylO 


yll 


yi2 


yl3 


yl4 


yl5 


yi 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


U 


y2 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


U 


y3 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y4 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y5 


0 


0 


0 


-1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y6 


0 


0 


0 


u 


1 

-1 


1 

i 


A 

u 


u 


n 
u 


yj 


0 


0 


0 


0 


0 


y7 


-1 


0 


-1 


0 


0 


2 




0 


0 


0 


0 


0 


0 


0 


0 


y8 


1 


-1 


0 


0 


0 


0 




1 


0 


0 


0 


0 


0 


0 


0 


y9 


0 


0 


1 


-1 


0 


0 




0 


1 


0 


0 


0 


0 


0 


0 


ylO 


1 


-i 


1 


-1 


0 


0 




0 


0 


1 


0 


0 


0 


0 


0 


yll 


0 


0 


1 


0 


-1 


0 




0 


0 


0 


1 


0 


0 


0 


0 


yl2 


1 


-1 


1 


0 


-1 


0 




0 


0 


0 


0 


1 


0 


0 


0 


yl3 


0 


-1 


1 


0 


0 


0 




0 


0 


0 


0 


0 


1 


0 


0 


yl4 


0 


0 


1 


0 


0 


-1 




0 


0 


0 


0 


0 


0 


1 


0 


yl5 


1 


-1 


1 


0 


0 


-1 




0 


0 


0 


0 


0 


0 




1 



As a result, the maximal set of independent rows of F are F^, F2, F3, F4, F5, F^, F7. The 
preferred measurements set is: 

Q = {(Ri, (Ri, R3), (Ri. R4). (Ri. R5). (Ri. K\ (Ri. R7). (R4. R2)} (51) 
The row vectors, [aKi, aKi? cCkq], k= 8, 9, ,,,, 15, are: 





yi 


y2 


y3 


y4 


y5 


y6 


y7 


a8 


-1 


1 


0 


0 


0 


0 




a9 


0 


0 




1 


0 


0 




alO 


-1 


1 




1 


0 


0 




all 


0 


0 




0 


1 


0 




al2 


-1 


1 




0 


1 


0 




al3 


0 


1 




0 


0 


0 




al4 


0 


0 




0 


0 


1 




al5 


-1 


1 




0 


0 


1 





Next, the start time to, and the measurement interval, dt, are identified. The 
cycle of taking measurements and making estimations of delay and delay-jitter can 
then be repeated as desired. 
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Many other examples will be apparent to one of skill in the art. For example, 
if the assigned priorities are instead, in decreasing priority, R4, R5, R^, R7, Rj, R2, R3? 
then the set, O, when sorted on the two keys, pref(Ri) and pref(Rj) results in: 



5 O = {(R4, Ri), (R4, R2), R3), Ri). (R5, R2). (R5. R3). 

(R,, R,), (R., R2), (R^, R3), (R7. Ri). (R7. R2). (R7, R3), 
(R„R,),(Ri,R3),(R2,R3)} (52) 



The corresponding matrix F is: 

10 





dll 


dl2 


dl3 


d21 


d31 


d41 


d42 


C12 


C13 


C14 


sll 


sl2 


sl3 


s21 


s31 


s41 


s42 








































1 


2 


3 


4 


5 


6 


7 
























1 






1 








1 


0 


0 


1 






1 








y2 




1 




1 








1 


0 


0 




1 




1 








y3 






1 


1 








1 


0 


0 






1 


1 








y4 


1 








I 






0 




0 


1 








1 






y5 




1 






1 






0 




0 




1 






1 






y6 






1 




1 






0 




0 






1 




1 






y7 


1 










1 




0 






1 










1 




yS 




1 








1 




0 








1 








1 




y9 






1 






1 




0 










1 






1 




yiO 


1 












1 


0 


0 




1 












1 


yll 




1 










1 


0 


0 






1 










1 


yl2 






1 








1 


0 


0 








1 








1 


yi3 


1 


1 












0 


0 


0 


1 


1 












yl4 


1 




1 










0 


0 


0 


1 




1 










yl5 




1 


1 










0 


0 


0 




1 


1 











Which when decomposed results in: 





dll 


dl2 


di3 


d21 


d31 


d41 


d42 


C12 


C13 


C14 


sll 


sl2 


sl3 


s21 


s31 


s41 


s42 


yi 


1 


0 


0 


1 


0 


0 


0 


1 


0 


0 


1 


0 


0 


1 


0 


0 


0 


y2 


0 


1 


0 


1 


0 


0 


0 


1 


0 


0 


0 


1 


0 


1 


0 


0 


0 


y3 


0 


0 


1 


1 


0 


0 


0 


1 


0 


0 


0 


0 


1 


1 


0 


0 


0 


y4 


0 


0 


0 


-1 


1 


0 


0 


-1 


1 


0 


0 


0 


0 


-I 


1 


0 


0 


y7 


0 


0 


0 


0 


-1 


1 


0 


0 


0 


1 


0 


0 


0 


0 


-1 


1 


0 


ylO 


0 


0 


0 


0 


0 


-1 


1 


0 


-1 


0 


0 


0 


0 


0 


0 


-1 


1 


yl3 


0 


0 


0 


0 


0 


0 


-2 


0 


0 


-2 


0 


0 


0 


0 


0 


0 


-2 


Y14 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


Y15 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yll 


0 


0 


0 


0 


0 


0 


D 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


yl2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


Y8 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


Y9 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


Y5 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


Y6 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



15 This establishes the fact that row vectors, F^, F2, F3, F4, F^, Fjo, and F13 are 
independent. Consequently, the preferred measurements set is: 



52- 
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Q = Ri), (R4. R2). (R4^ R3), Ri). (R6. Ri). (R7. Ri). (Ri. R2)} (53) 

As can be seen, the resulting preferred measurements set can be controlled, at least to 
some degree, by prioritizing the appropriate routers. Thus, by careful selection of 
5 routers, such a method and apparatus addresses the operator's (and network's) needs 
with regard to controlling the routers and links involved in the actual measurement of 
delay and delay-jitter. 

While particular embodiments of the present invention have been shown and 
described, it will be obvious to those skilled in the art that, based upon the teachings 
10 herein, changes and modifications may be made without departing from this invention 
and its broader aspects and, therefore, the appended claims are to encompass v^thin 
their scope all such changes and modifications as are within the true spirit and scope 
of this invention. Furthermore, it is to be understood that the invention is solely 
defined by the appended claims. 
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WHAT IS CLAIMED IS: 

1 LA method of determining a network performance metric in a network, 

2 wherein said network comprises a plurality of network elements and each one of said 

3 network elements is coupled to at least one other of said network elements by at least 

4 one of a plurality of Imks, comprising: 

5 forming a first set of network element pairs, said first set of network element 

6 pairs comprising a plurality of pairs of said network elements; 

7 ordering a first plurality of network element pairs comprising ones of network 

8 element pairs in said first set of network element pairs; 

9 forming a second set of network element pairs, wherein said second set of 

1 0 network element pairs comprises ones of said network element pairs in 

1 1 said first set of network element pairs; 

12 measuring a measured network performance metric between a first network 

1 3 element pair, wherein said first network element pair comprises a first 

14 network element and a second network element of one of said network 

1 5 element pairs in said second set of network element pairs; and 

1 6 computing a computed network performance metric between a second network 

17 element pair using said measured network performance metric, wherein 

1 8 said second network element pair comprises a first network element 

1 9 and a second network element of said network element pair in said first 

20 set of network element pairs. 

1 2. The method of claim 1, wherein said computed network performance 

2 metric is computed using a relationship between said first and said second network 

3 element pairs. 

1 3. The method of claim 1, wherein said ordering comprises: 

2 identifying a plurality of network elements, wherein each one of said plurality 

3 of network elements is one of a network element pair in said first set of 

4 network element pairs; 
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5 assigning one of a plurality of preferences to each one of said plurality of 

6 network elements; and 

7 sorting said network element pairs in said first set of network element pairs 

8 based on said plurality of preferences. 

1 4. The method of claim 3, wherein said sorting comprises: 

2 for each one of said network element pairs in said first set of network element 

3 pairs, swapping a first network element and a second network element 

4 in said each one of said network element pairs in said first set of 

5 network element pairs, if a preference of said first network element in 

6 said each one of said network element pairs in said first set of network 

7 element pairs is less than a preference of said second network element 

8 in said each one of said network element pairs in said first set of 

9 network element pairs; 

10 sorting said network element pairs in said first set of network element pairs 

1 1 based on a preference of a present first network element of said each 

12 one of said network element pairs in said first set of network element 

13 pairs; and 

14 sorting said network element pairs in said first set of network element pairs 

1 5 based on a preference of a present second network element of said each 

1 6 one of said network element pairs in said first set of network element 

17 pairs. 

1 5 . The method of claim 1 , fiirther comprising: 

2 forming a first matrix, wherein each row in said first matrix corresponds to a 

3 network element pair of said first set of network element pairs; and 

4 determining a set of independent rows of said first matrix. 

1 6. The method of claim 5, wherein said set of independent rows of said 



2 first matrix is a maximal set of independent rows of said first matrix. 
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1 7. The method of claim 5, wherein said forming said second set of 

2 network element pairs comprises: 

3 including independent network element pairs in said second set of network 

4 element pairs, wherein 

5 said independent network element pairs are ones of said network 

6 element pairs in said first set of network element pairs 

7 corresponding to rows of said first matrix in said set of 

8 independent rows of said first matrix. 

1 8. The method of claim 1, further comprising: 

2 forming a delay components vector; 

3 forming a first matrix, wherein 

4 said first matrix describes a relationship between said delay 

5 components vector and a delay between each of said network 

6 element pairs of said first set of network element pairs, 

7 each row in said first matrix corresponds to a network element pair of 

8 said first set of network element pairs; and 

9 determining a set of independent rows of said first matrix, wherein said 

10 forming said second set of network element pairs comprises 

1 1 including independent network element pairs in said second set of 

1 2 network element pairs, and 

13 said independent network element pairs are ones of said network 

14 element pairs in said first set of network element pairs 

15 corresponding to rows of said first matrix in said set of 

1 6 independent rows of said first matrix. 
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1 9. The method of claim 8, wherein said delay components vector 

2 comprises: 

3 a representation of a delay within each network element of each network 

4 element pair of said first set of network element pairs for said each 

5 network element pair of said first set of network element pairs, and 

6 a representation of a delay between network elements of said each network 

7 element pair of said first set of network element pairs for said each 

8 network element pair of said first set of network element pairs. 

1 10. The method of claim 8, further comprising: 

2 forming a second matrix, wherein 

3 said second matrix describes a relationship between a plurality of 

4 independent delays and a non-independent delay, 

5 said plurality of independent delays comprise a delay between network 

6 elements in each network element pair of said second set of 

7 network element pairs, and 

8 said non-independent delay comprises a delay between network 

9 elements in a network element pair of said first set of network 

1 0 element pairs that is not in said second set of network element 

1 1 pairs. 

1 11. The method of claim 1 0, wherein said forming said second matrix 

2 comprises performing a Gaussian elimination using said first and said second 

3 matrices. 

1 12. The method of claim 1 0, wherein said computing said computed 

2 network performance metric comprises: 

3 multiplying said measured performance metric by an element of said second 

4 matrix. 
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1 1 3 . A computer system comprising : 

2 a processor; 

3 a network interface, coupled to said processor and to a network, wherein said 

4 network comprises a plurality of network elements and each one of 

5 said network elements is coupled to at least one other of said network 

6 elements by at least one of a plurality of links; 

7 computer readable medium coupled to said processor; and 

8 computer code, encoded in said computer readable medium, configured to 

9 cause said processor to: 

1 0 form a first set of network element pairs, said first set of network 

1 1 element pairs comprising a plurality of pairs of said network 

12 elements; 

1 3 order a first plurality of network element pairs comprising ones of 

14 network element pairs in said first set of network element pairs; 

15 form a second set of network element pairs, wherein said second set of 

16 network element pairs comprises ones of said network element 

1 7 pairs in said first set of network element pairs; 

1 8 measure a measured network performance metric between a first 

1 9 network element pair, wherein said first network element pair 

20 comprises a first network element and a second network 

21 element of one of said network element pairs in said second set 

22 of network element pairs; and 

23 compute a computed network performance metric between a second 

24 network element pair using said measured network 

25 performance metric, wherein said second network element pair 

26 comprises a first network element and a second network 

27 element of said network element pair in said first set of network 

28 element pairs. 
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1 14. The computer system of claim 13, wherein said computed network 

2 performance metric is computed using a relationship between said first and said 

3 second network element pairs. 

1 15. The computer system of claim 1 3 , wherein said computer code 

2 configured to cause said processor to order said first plurality of network element 

3 pairs, is further configured to cause said processor to: 

4 identify a plurality of network elements, wherein each one of said plurality of 

5 network elements is one of a network element pair in said first set of 

6 network element pairs; 

7 assign one of a plurality of preferences to each one of said plurality of network 

8 elements; and 

9 sort said network element pairs in said first set of network element pairs based 
10 on said plurality of preferences. 

1 16. The computer system of claim 1 5, wherein said computer code 

2 configured to cause said processor to sort said network element pairs in said first set 

3 of network element pairs based on said plurality of preferences, is further configured 

4 to cause said processor to: 

5 for each one of said network element pairs in said first set of network element 

6 pairs, swap a first network element and a second network element in 

7 said each one of said network element pairs in said first set of network 

8 element pairs, if a preference of said first network element in said each 

9 one of said network element pairs in said first set of network element 

10 pairs is less than a preference of said second network element in said 

1 1 each one of said network element pairs in said first set of network 

12 element pairs; 

1 3 sort said network element pairs in said first set of network element pairs based 

14 on a preference of a present first network element of said each one of 
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1 5 said network element pairs in said first set of network element pairs; 

16 and 

1 7 sort said network element pairs in said first set of network element pairs based 

18 on a preference of a present second network element of said each one 

19 of said network element pairs in said first set of network element pairs. 

1 17. The computer system of claim 13, wherein said computer code is 

2 further configured to cause said processor to: 

3 form a first matrix, wherein each row in said first matrix corresponds to a 

4 network element pair of said first set of network element pairs; and 

5 determine a set of independent rows of said first matrix. 

1 18, The computer system of claim 17, wherein said set of independent 

2 rows of said first matrix is a maximal set of independent rows of said first matrix. 

1 1 9. The computer system of claim 17, wherein said computer code 

2 configured to cause said processor to form said second set of network element pairs, is 

3 further configured to cause said processor to: 

4 include independent network element pairs in said second set of network 

5 element pairs, wherein 

6 said independent network element pairs are ones of said network 

7 element pairs in said first set of network element pairs 

8 corresponding to rows of said first matrix in said set of 

9 independent rows of said first matrix. 

1 20. The computer system of claim 13, wherein said computer code is 

2 further configured to cause said processor to: 

3 form a delay components vector; 

4 form a first matrix, wherein 

5 said first matrix describes a relationship between said delay 

6 components vector and a delay between each of said network 

7 element pairs of said first set of network element pairs, 
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8 each row in said first matrix corresponds to a network element pair of 

9 said first set of network element pairs; and 

1 0 determine a set of independent rows of said first matrix, wherein said forming 

1 1 said second set of network element pairs comprises 

12 including independent network element pairs in said second set of 

1 3 network element pairs, and 

14 said independent network element pairs are ones of said network 

1 5 element pairs in said first set of network element pairs 

1 5 corresponding to rows of said first matrix in said set of 

1 7 independent rows of said first matrix. 

1 21 . The computer system of claim 20, wherein said delay components 

2 vector comprises: 

3 a representation of a delay within each network element of each network 

4 element pair of said first set of network element pairs for said each 

5 network element pair of said first set of network element pairs, and 

6 a representation of a delay between network elements of said each network 

7 element pair of said first set of network element pairs for said each 

8 network element pair of said first set of network element pairs. 

1 22. The computer system of claim 20, wherein said computer code is 

2 further configured to cause said processor to: 

3 form a second matrix, wherein 

4 said second matrix describes a relationship between a plurality of 

5 independent delays and a non-independent delay, 

6 said plurality of independent delays comprise a delay between network 

7 elements in each network element pair of said second set of 

8 network element pairs, and 

9 said non-independent delay comprises a delay between network 

1 0 elements in a network element pair of said first set of network 
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1 1 element pairs that is not in said second set of network element 

12 pairs. 

1 23. The computer system of claim 22, wherein said computer code 

2 configured to cause said processor to form said second matrix, is further configured to 

3 cause said processor to: 

4 perform a Gaussian elimination using said first and said second matrices. 

1 24. The computer system of claim 22, wherein said computer code 

2 configured to cause said processor to compute a computed network performance 

3 metric, is further configured to cause said processor to: 

4 multiply said measured performance metric by an element of said second 

5 matrix. 

1 25 . A computer program product encoded in computer readable media, 

2 said computer program product comprising: 

3 a first set of instructions, executable on a computer system, configured to form 

4 a first set of network element pairs, said first set of network element 

5 pairs comprising a plurality of pairs of said network elements; 

6 a second set of instructions, executable on said computer system, configured to 

7 order a first plurality of network element pairs comprising ones of 

8 network element pairs in said first set of network element pairs; 

9 a third set of instructions, executable on said computer system, configxired to 

1 0 form a second set of network element pairs, wherein said second set of 

1 1 network element pairs comprises ones of said network element pairs in 

1 2 said first set of network element pairs; 

13 a fourth set of instructions, executable on said computer system, configured to 

1 4 measure a measured network performance metric between a first 

1 5 network element pair, wherein said first network element pair 

16 comprises a first network element and a second network element of 
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17 one of said network element pairs in said second set of network 

1 8 element pairs; and 

19 a fifth set of instructions, executable on said computer system, configured to 

20 compute a computed network performance metric between a second 

21 network element pair using said measured network performance 

22 metric, wherein said second network element pair comprises a first 

23 network element and a second network element of said network 

24 element pair in said first set of network element pairs. 

1 26. The computer program product of claim 25, wherein fifth set of 

2 instructions cause said computer system to compute said computed network 

3 performance metric using a relationship between said first and said second network 

4 element pairs. 

1 27. The computer program product of claim 25, wherein said second set of 

2 instructions comprises: 

3 a sixth set of instructions, executable on said computer system, configured to 

4 identify a plurality of network elements, wherein each one of said 

5 plurality of network elements is one of a network element pair in said 

6 first set of network element pairs; 

7 a seventh set of instructions, executable on said computer system, configured 

8 to identify a plurality of network elements, wherein each one of said 

9 plurality of network elements is one of a network element pair in said 

1 0 first set of network element pairs; and 

11 a eighth set of instructions, executable on said computer system, configured to 

12 identify a plurality of network elements, wherein each one of said 

13 plurality of network elements is one of a network element pair in said 

1 4 first set of network element pairs. 
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1 28, The computer program product of claim 27, wherein said eighth set of 

2 instructions comprises: 

3 a first sub-set of instructions, executable on said computer system, configmed 

4 to, for each one of said network element pairs in said first set of 

5 network element pairs, swap a first network element and a second 

6 network element in said each one of said network element pairs in said 

7 first set of network element pairs, if a preference of said first network 

8 element in said each one of said network element pairs in said first set 

9 of network element pairs is less than a preference of said second 

10 network element in said each one of said network element pairs in said 

1 1 first set of network element pairs; 

12 a second sub-set of instructions, executable on said computer system, 

1 3 configured to sort said network element pairs in said first set of 

14 network element pairs based on a preference of a present first network 

1 5 element of said each one of said network element pairs in said first set 

16 of network element pairs ; and 

17 an third sub-set of instructions, executable on said computer system, 

1 8 configured to sort said network element pairs in said first set of 

1 9 network element pairs based on a preference of a present second 

20 network element of said each one of said network element pairs in said 

21 first set of network element pairs. 

1 29. The computer program product of claim 25, fiirther comprising: 

2 a sixth set of instructions, executable on said computer system, configured to 

3 form a first matrix, wherein each row in said first matrix corresponds 

4 to a network element pair of said first set of network element pairs; and 

5 a seventh set of instructions, executable on said computer system, configured 

6 to determine a set of independent rows of said first matrix. 
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1 30, The computer program product of claim 29, wherein said set of 

2 independent rows of said first matrix is a maximal set of independent rows of said 

3 first matrix. 

1 31. The computer program product of claim 29, wherein said third set of 

2 instructions comprises: 

3 a first sub-set of instructions, executable on said computer system, configured 

4 to include independent network element pairs in said second set of 

5 network element pairs, wherein 

6 said independent network element pairs are ones of said network 

7 element pairs in said first set of network element pairs 

8 corresponding to rows of said first matrix in said set of 

9 independent rows of said first matrix. 

1 32. The computer program product of claim 25 , further comprising: 

2 a sixth set of instructions, executable on said computer system, configured to 

3 form a delay components vector; 

4 a seventh set of instructions, executable on said computer system, configured 

5 to form a first matrix, wherein 

6 said first matrix describes a relationship between said delay 

7 components vector and a delay between each of said network 

8 element pairs of said first set of network element pairs, 

9 each row in said first matrix corresponds to a network element pair of 

10 said first set of network element pairs; and 

1 1 a eighth set of instructions, executable on said computer system, configured to 

1 2 determine a set of independent rows of said first matrix, wherein said 

13 forming said second set of network element pairs comprises 

14 including independent network element pairs in said second set of 

1 5 network element pairs, and 
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1 6 said independent network element pairs are ones of said network 

17 element pairs in said first set of network element pairs 
1 g corresponding to rows of said first matrix in said set of 
1 9 independent rows of said first matrix. 

1 33. The computer program product of claim 32, wherein said delay 

2 components vector comprises: 

3 a representation of a delay within each network element of each network 

4 element pair of said first set of network element pairs for said each 

5 network element pair of said first set of network element pairs, and 

6 a representation of a delay between network elements of said each network 

7 element pair of said first set of network element pairs for said each 

8 network element pair of said first set of network element pairs. 

1 34. The computer program product of claim 32, further comprising: 

2 a ninth set of instructions, executable on said computer system, configured to 

3 form a second matrix, wherein 

4 said second matrix describes a relationship between a plurality of 

5 independent delays and a non-independent delay, 

6 said plurality of independent delays comprise a delay between network 

7 elements in each network element pair of said second set of 

8 network element pairs, and 

9 said non-independent delay comprises a delay between network 

1 0 elements in a network element pair of said first set of network 

1 1 element pairs that is not in said second set of network element 

12 pairs. 



649926 v3 

Client Ref. No.: 67867 Weil No.: 2252 



-66- 



Attorney Docket No. M-8368 US 



1 35 . The computer program product of claim 34, wherein said ninth set of 

2 instructions comprises: 

3 a first sub-set of instructions, executable on said computer system, configured 

4 to perform a Gaussian elimination using said first and said second 

5 matrices. 

1 36. The computer program product of claim 34, wherein said fifth set of 

2 instructions comprises: 

3 a first sub-set of instructions, executable on said computer system, configured 

4 to multiply said measured performance metric by an element of said 

5 second matrix. 

1 37. A computer system comprising: 

2 a network interface, coupled to said processor and to a network, wherein said 

3 network comprises a plurality of network elements and each one of 

4 said network elements is coupled to at least one other of said network 

5 elements by at least one of a plurality of links; 

6 means for forming a furst set of network element pairs, said first set of network 

7 element pairs comprising a plurality of pairs of said network elements; 

8 means for ordering a first plurality of network element pairs comprising ones 

9 of network element pairs in said first set of network element pairs; 

10 means for forming a second set of network element pairs, wherein said second 

1 1 set of network element pairs comprises ones of said network element 

12 pairs in said first set of network element pairs 

1 3 means for measxiring a measured network performance metric between a first 

14 network element pair, wherein said first network element pair 

1 5 comprises a first network element and a second network element of 

16 one of said network element pairs in said second set of network 

1 7 element pairs; and 
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means for computing a computed network performance metric between a 
second network element pair using said measured network 
performance metric, wherein said second network element pair 
comprises a first network element and a second network element of 
said network element pair in said first set of network element pairs. 

38. The method of claim 37, wherein said computed network performance 
metric is computed using a relationship between said first and said second network 
element pairs. 

39. The computer system of claim 37, further comprising: 

means for identifying a plurality of network elements, wherein each one of 

said plurality of network elements is one of a network element pair in 

said first set of network element pairs; 
means for assigning one of a plurality of preferences to each one of said 

plurality of network elements; and 
means for sorting said network element pairs in said first set of network 

element pairs based on said plurality of preferences. 

40. The computer system of claim 39, wherein said sorting means 
comprises: 

means, for each one of said network element pairs in said first set of network 
element pairs, for swapping a first network element and a second 
network element in said each one of said network element pairs in said 
first set of network element pairs, if a preference of said first network 
element in said each one of said network element pairs in said first set 
of network element pairs is less than a preference of said second 
network element in said each one of said network element pairs in said 
first set of network element pairs. 

means for sorting said network element pairs in said first set of network 

element pairs based on a preference of a present first network element 
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13 of said each one of said network element pairs in said first set of 

1 4 network element pairs; and 

1 5 means for sorting said network element pairs in said first set of network 

1 6 element pairs based on a preference of a present second network 

17 element of said each one of said network element pairs in said first set 

18 of network element pairs. 

1 41 . The computer system of claim 37, fiirther comprising: 

2 means for forming a first matrix, wherein each row in said first matrix 

3 corresponds to a network element pair of said first set of network 

4 element pairs; and 

5 means for determining a set of independent rows of said first matrix. 

1 42. The computer system of claim 4 1 , wherein said set of independent 

2 rows of said first matrix is a maximal set of independent rows of said first matrix. 

1 43 . The computer system of claim 41 , wherein said means for forming said 

2 second set of network element pairs comprises: 

3 means for including independent network element pairs in said second set of 

4 network element pairs, wherein 

5 said independent network element pairs are ones of said network 

6 element pairs in said first set of network element pairs 

7 corresponding to rows of said first matrix in said set of 

8 independent rows of said first matrix. 

1 44. The computer system of claim 37, further comprising: 

2 means for forming a delay components vector; 

3 means for forming a first matrix, wherein 

4 said first matrix describes a relationship between said delay 

5 components vector and a delay between each of said network 

6 element pairs of said first set of network element pairs, 
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7 each row in said first matrix corresponds to a network element pair of 

8 said first set of network element pairs; and 

9 means for determining a set of independent rows of said first matrix, wherein 

10 said forming said second set of network element pairs comprises 

1 1 including independent network element pairs in said second set of 

1 2 network element pairs, and 

1 3 said independent network element pairs are ones of said network 

14 element pairs in said first set of network element pairs 

1 5 corresponding to rows of said first matrix in said set of 

1 6 independent rows of said first matrix. 

1 45 . The computer system of claim 44, wherein said delay components 

2 vector comprises : 

3 a representation of a delay within each network element of each network 

4 element pair of said first set of network element pairs for said each 

5 network element pair of said first set of network element pairs, and 

6 a representation of a delay between network elements of said each network 

7 element pair of said first set of network element pairs for said each 

8 network element pair of said first set of network element pairs. 

1 46. The method of claim 44, fiirther comprising: 

2 means for forming a second matrix, wherein 

3 said second matrix describes a relationship between a plurality of 

4 independent delays and a non-independent delay, 

5 said plurality of independent delays comprise a delay between network 

6 elements in each network element pair of said second set of 

7 network element pairs, and 

8 said non-independent delay comprises a delay between network 

9 elements in a network element pair of said first set of network 

10 element pairs that is not in said second set of network element 

1 1 pairs. 
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1 47. The computer system of claim 46, wherein said means for forming said 

2 second matrix comprises means for performing a Gaussian eUmination using said first 

3 and said second matrices. 

1 48. The computer system of claim 46, wherein said means for computing 

2 said computed network performance metric comprises: 

3 means for multiplying said measured performance metric by an element of 

4 said second matrix. 
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METHOD AND APPARATUS FOR ESTIMATING DELAY AND JITTER 
BETWEEN MANY NETWORK ROUTERS USING MEASUREMENTS 
BETWEEN A PREFERRED SET OF ROUTERS 

Jain, BijendraN. 

5 McCloghrie, Keith 

ABSTRACT 

A method and apparatus for determining a network performance metric in a 
network is described. The network includes a number of network elements and a 
number of links. Each of the network elements is coupled to at least one other of the 

10 network elements by at least one of the links. The method includes forming a first set 
of network element pairs, ordering a first number of network element pairs, forming a 
second set of network element pairs, measuring a measured network performance 
metric between a first network element pair and computing a computed network 
performance metric. The first set of network element pairs include a number of pairs 

15 of the network elements. The ordering of a first number of network element pairs 
includes network element pairs in the first set of network element pairs. The second 
set of network element pairs includes network element pairs in the first set of network 
element pairs. The measurement is taken between a first network element pair. The 
first network element pair includes a first network element and a second network 

20 element of one of the network element pairs in the second set of network element 
pairs. The computed network performance metric is computed between a second 
network element pair using the measured network performance metric. The second 
network element pair includes a first network element and a second network element 
of the network element pair in the first set of network element pairs. 
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As a below named inventor^ I hereby declare that: 

My residence, post office address and citizenship are as stated below adjacent to my name. 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, 
first and joint inventor (if plural names are listed below) of subject matter (process, machine, 
manufacture, or composition of matter, or an improvement thereof) which is claimed and for which a 
patent is sought by way of the application entitled 

Method And Apparatus For Estimating Delay And Jitter 
Between Many Network Routers Using Measurements 
Between A Preferred Set of Routers 

which (check) ^ is attached hereto. 

n and is amended by the Preliminary Amendment attached hereto. 

I I was filed on as Application Serial No. 

Q and was amended on (if applicable). 

I hereby state that I have reviewed and understand the contents of the above identified specification, 
including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information, which is material to patentability as defined in Title 
37, Code of Federal Regulations, § 1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, § 1 19(a)-(d) of any foreign 
application(s) for patent or inventor's certificate or any PCT international application(s) designating at 
least one country other than the United States of America listed below and have also identified below 
any foreign application(s) for patent or inventor's certificate or any PCT international application(s) 
designating at least one country other than the United States of America filed by me on the same 
subject matter having a filing date before that of the application(s) of which priority is claimed: 
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I hereby claim the benefit under Title 35, United States Code, § 120 of any United States 
application(s) or PCX international application(s) designating the United States of America listed 
below and, insofar as the subject matter of each of the claims of this application is not disclosed in the 
prior application(s) in the manner provided by the first paragraph of Title 35, United States Code, § 
112, 1 acknowledge the duty to disclose information, which is material to patentability as defined in 
Title 37, Code of Federal Regulations, § L56, which became available between the filing date of the 
prior application(s) and the national or PCT international filing date of this application: 



Application Serial No. 


Filing Date 


Status (patented, pending, abandoned) 
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I hereby appoint the following attomey(s) and/or agent(s) to prosecute this application and to transact 
all business in the United States Patent and Trademark Office connected therewith: 



Alan H. MacPherson (24,423); Brian D. Ogonowsky (3 1,988); David W. Heid (25,875); Norman R. 
Klivans (33,003); Edward C. Kwok (33,938); David E. Steuber (25,557); Michael Shenker (34,250); 
Stephen A. Terrile (32,946); Peter H. Kang (40,350); Ronald J, Meetin (29,089); Ken John Koestner 
(33,004); Omkar K. Suryadevara (36,320); David T. Millers (37,396); Michael P. Adams (34,763); 
Robert B. Morrill (43,817); James E. Parsons (34,691); Philip W. Woo (39,880); Emily Haliday 
(38,903); Tom Hunter (38,498); Michael J. Halbert (40,633); Gary J. Edwards (41,008); Daniel P. 
Stewart (41,332); John T. Winbum (26,822); Tom Chen (42,406); Fabio E. Marino (43,339); Don C. 
Lawrence (31,975); Marc R. Ascolese (42,268); Carmen C. Cook (42,433); David G. Dolezal 
(41,71 1); Roberta P. Saxon (43,087); Mary Jo Bertani (42,321); Dale R. Cook (42,434); Sam G. 
Campbell (42,381); Matthew J. Brigham (44,047); Hugh H. Matsubayashi (43,779); Patrick D. 
Benedicto (40,909); TJ, Singh (39,535); Shireen Irani Bacon (40,494); Rory G. Bens (44,028); 
George Wolken, Jr. (30,441); John A. Odozynski (28,769); Cameron K, Kerrigan (44,826); Paul E. 
Lewkowicz (44,870); Theodore P. Lopez (44,881); Mayankkumar M. Dixit (44,064); Eric Stephenson 
(38,321); Christopher Allenby (45,906); David C. Hsia (46,235); Mark J. Rozman (42,1 17); Margaret 
M. Kelton (44, 182); Do Te Kim (46,231); Alex Chen (45,591); Monique M. Heyninck (44,763); 
Gregory J. Michelson (44,940); Jonathan Geld (44,702); Emmanuel Rivera (45,760); Jason FarHadian 
(42,523); Matthew J. Spark (43,453); and Elaine H. Lo (41,158). 

Please address all correspondence and telephone calls to: 

Sam Campbell 
Attorney for Applicant(s) 
SKJERVEN MORRILL MacPHERSON llp 

25 Metro Drive, Suite 700 
San Jose, California 95110-1349 

Telephone: 5 12-794-3600 
Facsimile: 512-794-3601 

I declare that all statements made herein of my own knowledge are true, all statements made herein on 
information and belief are believed to be true, and all statements made herein are made with the 
knowledge that whoever, in any matter within the jurisdiction of the Patent and Trademark Office, 
knowingly and willfully falsifies, conceals, or covers up by any trick, scheme, or device a material 
fact, or makes any false, fictitious or fraudulent statements or representations, or makes or uses any 
false writing or document knowing the same to contain any false, fictitious or fraudulent statement or 
entry, shall be subject to the penalties including fine or imprisonment or both as set forth under 1 8 
U.S.C. 1001, and that violations of this paragraph may jeopardize the validity of the application or 
this document, or the validity or enforceability of any patent, trademark registration, or certificate 
resulting therefrom. 
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Full name of sole (or first joint) inventor: Jain, Bijendra N. 



Date: 

Santa Clara, California 

1561 Warburton Ave., #9 Citizenship: 
Santa Clara, CA 95050 



Full name of second inventor: 



Inventor's Signature: 

Residence: 

Post Office Address: 



Inventor's Signature: 

Residence: 

Post Office Address: 



San Jose, California 
1 190 Hyde Avenue 
San Jose, CA 95129 



McCloghrie, Keith 



India 



Date: 



Citizenship: UK 
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